2023-11-08T16:21:57.464 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-08T16:21:57.466 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000 --verbose --owner scheduled_yuriw@teuthology --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} --name yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000/orig.config.yaml 2023-11-08T16:21:57.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T16:21:57.579 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000 branch: wip-yuri3-testing-2023-11-07-0801-pacific description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} email: null first_in_suite: false job_id: '7452000' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri3-testing-2023-11-07-0801-pacific ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-11-07-0801-pacific sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9776 sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri3-testing-2023-11-07-0801-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f targets: smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-08_16:13:26 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714 2023-11-08T16:21:57.580 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa; will attempt to use it 2023-11-08T16:21:57.580 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks 2023-11-08T16:21:57.581 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-08T16:21:57.582 INFO:teuthology.task.internal:Checking packages... 2023-11-08T16:21:57.608 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f' 2023-11-08T16:21:57.609 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-08T16:21:57.609 INFO:teuthology.packaging:ref: None 2023-11-08T16:21:57.610 INFO:teuthology.packaging:tag: None 2023-11-08T16:21:57.610 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-11-07-0801-pacific 2023-11-08T16:21:57.610 INFO:teuthology.packaging:sha1: cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f 2023-11-08T16:21:57.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri3-testing-2023-11-07-0801-pacific 2023-11-08T16:21:57.855 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-129-gcfb6fd52-1focal 2023-11-08T16:21:57.855 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-08T16:21:57.861 INFO:teuthology.task.internal:no buildpackages task found 2023-11-08T16:21:57.861 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-08T16:21:57.866 INFO:teuthology.task.internal:Saving configuration 2023-11-08T16:21:57.879 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-08T16:21:57.886 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T16:21:57.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 16:16:04.650162', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-08T16:21:57.915 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-08T16:21:57.920 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-11-08T16:21:57.921 INFO:teuthology.run_tasks:Running task console_log... 2023-11-08T16:21:57.962 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5361bb6a60>, signals=[15]) 2023-11-08T16:21:57.963 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-08T16:21:57.969 INFO:teuthology.task.internal:Opening connections... 2023-11-08T16:21:57.969 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:21:57.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:21:58.021 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-08T16:21:58.027 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2023-11-08T16:21:58.144 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2023-11-08T16:21:58.145 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2023-11-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2023-11-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2023-11-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="20.04" 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-08T16:21:58.154 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=focal 2023-11-08T16:21:58.154 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=focal 2023-11-08T16:21:58.155 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2023-11-08T16:21:58.181 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-08T16:21:58.189 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-08T16:21:58.193 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-08T16:21:58.194 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2023-11-08T16:21:58.199 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-08T16:21:58.205 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-08T16:21:58.206 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2023-11-08T16:21:58.220 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-08T16:21:58.253 INFO:teuthology.run_tasks:Running task kernel... 2023-11-08T16:21:58.267 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-08T16:21:58.267 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-08T16:21:58.268 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-08T16:21:58.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T16:21:58.274 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-11-08T16:21:58.281 INFO:teuthology.orchestra.run.smithi196.stdout:5.4.0-124-generic 2023-11-08T16:21:58.281 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.4.0-124-generic 2023-11-08T16:21:58.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2023-11-08T16:21:58.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-11-08T16:21:58.585 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-08T16:21:58.586 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-08T16:21:58.643 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-11-08T16:21:58.673 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-11-08T16:21:58.974 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [906 kB] 2023-11-08T16:21:59.074 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,957 kB] 2023-11-08T16:21:59.123 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [481 kB] 2023-11-08T16:21:59.129 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-11-08T16:21:59.129 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-11-08T16:21:59.130 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,479 kB] 2023-11-08T16:21:59.162 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [346 kB] 2023-11-08T16:21:59.166 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-11-08T16:21:59.166 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [754 kB] 2023-11-08T16:21:59.177 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,128 kB] 2023-11-08T16:21:59.188 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [270 kB] 2023-11-08T16:21:59.198 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-11-08T16:21:59.198 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-11-08T16:21:59.198 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-11-08T16:21:59.198 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-11-08T16:21:59.199 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-11-08T16:21:59.215 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-11-08T16:21:59.216 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-11-08T16:21:59.217 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-11-08T16:21:59.217 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-11-08T16:21:59.217 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-11-08T16:21:59.218 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-11-08T16:21:59.290 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [672 kB] 2023-11-08T16:21:59.619 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,569 kB] 2023-11-08T16:21:59.808 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [398 kB] 2023-11-08T16:21:59.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-11-08T16:21:59.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-11-08T16:21:59.823 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,367 kB] 2023-11-08T16:21:59.892 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [329 kB] 2023-11-08T16:21:59.898 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-11-08T16:21:59.898 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [620 kB] 2023-11-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [896 kB] 2023-11-08T16:22:00.109 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [188 kB] 2023-11-08T16:22:00.528 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-11-08T16:22:00.533 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-11-08T16:22:00.535 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-11-08T16:22:00.543 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-11-08T16:22:00.545 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-11-08T16:22:03.132 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 18.0 MB in 3s (6,796 kB/s) 2023-11-08T16:22:04.611 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:22:04.638 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-08T16:22:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:22:04.916 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-11-08T16:22:04.916 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-11-08T16:22:05.106 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2023-11-08T16:22:05.107 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.4.0-166 linux-headers-5.4.0-166-generic 2023-11-08T16:22:05.107 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.4.0-166-generic 2023-11-08T16:22:05.107 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.4.0-166-generic linux-modules-extra-5.4.0-166-generic 2023-11-08T16:22:05.108 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2023-11-08T16:22:05.108 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-11-08T16:22:05.108 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2023-11-08T16:22:05.108 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2023-11-08T16:22:05.168 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2023-11-08T16:22:05.169 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.4.0-166 linux-headers-5.4.0-166-generic 2023-11-08T16:22:05.169 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-166-generic linux-modules-5.4.0-166-generic 2023-11-08T16:22:05.170 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.4.0-166-generic 2023-11-08T16:22:05.170 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2023-11-08T16:22:05.171 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2023-11-08T16:22:05.231 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 273 not upgraded. 2023-11-08T16:22:05.232 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 77.1 MB of archives. 2023-11-08T16:22:05.232 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 380 MB of additional disk space will be used. 2023-11-08T16:22:05.232 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-166-generic amd64 5.4.0-166.183 [15.0 MB] 2023-11-08T16:22:05.647 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-166-generic amd64 5.4.0-166.183 [10.5 MB] 2023-11-08T16:22:05.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-166-generic amd64 5.4.0-166.183 [39.2 MB] 2023-11-08T16:22:06.503 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.166.163 [1,900 B] 2023-11-08T16:22:06.503 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.166.163 [2,592 B] 2023-11-08T16:22:06.503 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-166 all 5.4.0-166.183 [11.0 MB] 2023-11-08T16:22:06.741 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-166-generic amd64 5.4.0-166.183 [1,370 kB] 2023-11-08T16:22:06.778 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.166.163 [2,464 B] 2023-11-08T16:22:07.488 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 77.1 MB in 2s (48.2 MB/s) 2023-11-08T16:22:07.647 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.4.0-166-generic. 2023-11-08T16:22:09.414 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-11-08T16:22:09.419 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.4.0-166-generic_5.4.0-166.183_amd64.deb ... 2023-11-08T16:22:09.544 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:11.444 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.4.0-166-generic. 2023-11-08T16:22:11.457 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.4.0-166-generic_5.4.0-166.183_amd64.deb ... 2023-11-08T16:22:11.561 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:12.656 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-166-generic. 2023-11-08T16:22:12.669 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-166-generic_5.4.0-166.183_amd64.deb ... 2023-11-08T16:22:12.739 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:17.632 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.4.0.166.163_amd64.deb ... 2023-11-08T16:22:17.784 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.4.0.166.163) over (5.4.0.124.125) ... 2023-11-08T16:22:18.142 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.166.163_amd64.deb ... 2023-11-08T16:22:18.271 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.4.0.166.163) over (5.4.0.124.125) ... 2023-11-08T16:22:18.624 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.4.0-166. 2023-11-08T16:22:18.637 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.4.0-166_5.4.0-166.183_all.deb ... 2023-11-08T16:22:18.682 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.4.0-166 (5.4.0-166.183) ... 2023-11-08T16:22:24.136 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.4.0-166-generic. 2023-11-08T16:22:24.156 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.4.0-166-generic_5.4.0-166.183_amd64.deb ... 2023-11-08T16:22:24.194 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:26.874 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.166.163_amd64.deb ... 2023-11-08T16:22:27.017 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.4.0.166.163) over (5.4.0.124.125) ... 2023-11-08T16:22:27.359 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:28.564 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.4.0-166 (5.4.0-166.183) ... 2023-11-08T16:22:28.707 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:29.849 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-166-generic 2023-11-08T16:22:29.850 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-166-generic 2023-11-08T16:22:29.992 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:30.135 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:31.311 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.4.0.166.163) ... 2023-11-08T16:22:31.437 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.4.0.166.163) ... 2023-11-08T16:22:31.597 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.4.0.166.163) ... 2023-11-08T16:22:31.723 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.4.0-166-generic (5.4.0-166.183) ... 2023-11-08T16:22:31.793 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-11-08T16:22:31.793 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-166-generic 2023-11-08T16:22:53.962 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-11-08T16:22:53.963 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2023-11-08T16:22:53.975 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T16:22:53.999 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2023-11-08T16:22:54.313 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-166-generic 2023-11-08T16:22:54.338 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-166-generic 2023-11-08T16:22:54.750 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T16:22:54.762 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T16:22:57.633 INFO:teuthology.orchestra.run.smithi196.stdout:done 2023-11-08T16:22:58.092 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2023-11-08T16:22:58.151 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2023-11-08T16:22:58.151 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2023-11-08T16:22:58.151 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2023-11-08T16:22:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2023-11-08T16:22:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 20 2023-11-08T16:22:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2023-11-08T16:22:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2023-11-08T16:22:58.152 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2023-11-08T16:22:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.4.0.166.163 2023-11-08T16:22:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-08T16:22:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.4.0-166-generic, linux-modules-extra-5.4.0-166-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-08T16:22:58.153 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2023-11-08T16:22:58.154 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2023-11-08T16:22:58.154 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2023-11-08T16:22:58.154 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2023-11-08T16:22:58.154 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-166-generic 2023-11-08T16:22:58.155 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-08T16:22:58.155 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-08T16:22:58.155 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-08T16:22:58.156 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2023-11-08T16:22:58.156 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2023-11-08T16:22:58.226 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-11-08T16:22:58.367 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-08T16:22:58.369 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-08T16:22:58.384 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-08T16:22:58.405 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-08T16:23:00.125 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:23:00.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-11-08T16:23:00.218 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:23:00.428 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-11-08T16:23:00.429 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-11-08T16:23:00.655 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.4.0.166.163). 2023-11-08T16:23:00.656 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 273 not upgraded. 2023-11-08T16:23:00.658 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2023-11-08T16:23:00.680 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2023-11-08T16:23:00.681 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2023-11-08T16:23:00.681 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2023-11-08T16:23:00.681 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2023-11-08T16:23:00.681 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 20 2023-11-08T16:23:00.682 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2023-11-08T16:23:00.682 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2023-11-08T16:23:00.682 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2023-11-08T16:23:00.682 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.4.0.166.163 2023-11-08T16:23:00.682 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-11-08T16:23:00.683 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.4.0-166-generic, linux-modules-extra-5.4.0-166-generic, linux-firmware, intel-microcode, amd64-microcode 2023-11-08T16:23:00.683 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2023-11-08T16:23:00.683 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2023-11-08T16:23:00.683 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2023-11-08T16:23:00.684 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2023-11-08T16:23:00.684 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-11-08T16:23:00.689 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.IK8pKn3vgl 2023-11-08T16:23:00.690 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.IK8pKn3vgl 2023-11-08T16:23:00.705 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.IK8pKn3vgl 2023-11-08T16:23:00.786 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.IK8pKn3vgl is 9KB 2023-11-08T16:23:00.801 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.IK8pKn3vgl 2023-11-08T16:23:00.808 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-11-08T16:23:00.863 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:23:00.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-11-08T16:23:00.864 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-11-08T16:23:00.900 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-166-generic 2023-11-08T16:23:00.901 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2023-11-08T16:23:02.210 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2023-11-08T16:23:02.215 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-08T16:23:02.228 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2023-11-08T16:23:02.466 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-166-generic 2023-11-08T16:23:02.478 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-166-generic 2023-11-08T16:23:02.825 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-08T16:23:02.837 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-08T16:23:04.523 INFO:teuthology.orchestra.run.smithi196.stderr:done 2023-11-08T16:23:04.525 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2023-11-08T16:23:34.554 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-08T16:23:34.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:23:34.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:23:52.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-11-08T16:24:01.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:24:01.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:24:05.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-11-08T16:24:17.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:24:17.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:24:35.451 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.196 2023-11-08T16:24:50.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:24:50.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:24:50.694 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-11-08T16:24:51.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:24:51.285 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-166-generic"... 2023-11-08T16:24:51.286 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2023-11-08T16:24:51.292 INFO:teuthology.orchestra.run.smithi196.stdout:5.4.0-166-generic 2023-11-08T16:24:51.292 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-166-generic vs 5.4.0-166-generic 2023-11-08T16:24:51.293 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-08T16:24:51.293 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-08T16:24:52.294 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-08T16:24:52.295 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-08T16:24:52.405 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2023-11-08T16:24:52.433 DEBUG:teuthology.parallel:result is None 2023-11-08T16:24:52.433 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-08T16:24:52.442 INFO:teuthology.task.internal:Creating test directory... 2023-11-08T16:24:52.443 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-08T16:24:52.450 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-08T16:24:52.457 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-08T16:24:52.535 INFO:teuthology.task.internal:Creating archive directory... 2023-11-08T16:24:52.535 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-08T16:24:52.556 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-08T16:24:52.566 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-08T16:24:52.566 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-08T16:24:52.610 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T16:24:52.620 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-08T16:24:52.621 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-08T16:24:52.629 INFO:teuthology.task.internal:Configuring sudo... 2023-11-08T16:24:52.629 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-08T16:24:52.643 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-08T16:24:52.742 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-08T16:24:52.743 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-08T16:24:52.750 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-08T16:24:52.801 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-08T16:24:52.810 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:24:52.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-08T16:24:52.844 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2023-11-08T16:24:52.938 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-08T16:24:52.947 INFO:teuthology.task.internal:Starting timer... 2023-11-08T16:24:52.947 INFO:teuthology.run_tasks:Running task pcp... 2023-11-08T16:24:52.990 INFO:teuthology.run_tasks:Running task selinux... 2023-11-08T16:24:53.002 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2023-11-08T16:24:53.003 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-08T16:24:53.003 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-08T16:24:53.004 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-08T16:24:53.004 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-08T16:24:53.038 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-08T16:24:53.043 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-08T16:24:53.159 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-08T16:24:53.173 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-08T16:24:53.174 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-08T16:30:34.675 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2023-11-08T16:30:34.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:30:34.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-08T16:30:34.728 DEBUG:teuthology.orchestra.run.smithi196:> true 2023-11-08T16:30:34.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2023-11-08T16:30:34.856 INFO:teuthology.run_tasks:Running task clock... 2023-11-08T16:30:34.867 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-08T16:30:34.868 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-08T16:30:34.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T16:30:34.933 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-08T16:30:34.934 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Command line: ntpd -gq 2023-11-08T16:30:34.934 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: proto: precision = 0.088 usec (-23) 2023-11-08T16:30:34.935 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T16:30:34.935 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-08T16:30:34.936 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-08T16:30:34.937 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: restrict ::: KOD does nothing without LIMITED. 2023-11-08T16:30:34.938 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen and drop on 0 v6wildcard [::]:123 2023-11-08T16:30:34.938 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-08T16:30:34.938 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen normally on 2 lo 127.0.0.1:123 2023-11-08T16:30:34.938 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2023-11-08T16:30:34.939 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen normally on 4 lo [::1]:123 2023-11-08T16:30:34.939 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2023-11-08T16:30:34.939 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:34 ntpd[22895]: Listening on routing socket on fd #22 for interface updates 2023-11-08T16:30:35.934 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:35 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:35.934 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:35 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:37.934 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:37.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:37.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:37.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:37.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:37.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:37 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:38.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:38.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:38.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:38.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:38.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:38.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:38.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:38.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:38.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:38.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:38.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:38.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:38 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:39.934 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:39.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:39.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:39.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:39.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:39.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:39 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:40.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:40.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:40.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:40.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:40.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:40.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:40.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:40.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:40.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:40.938 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:40.938 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:40.938 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:40 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:41.934 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:41.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:41.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:41.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:41.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:41.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:41 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:42.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:42.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:42.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:42.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:42.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:42.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:42.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:42.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:42.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:42.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:42.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:42.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:42 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:43.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:43.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:43.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-08T16:30:43.935 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: can't open /var/log/ntpstats/rawstats.20231108: Permission denied 2023-11-08T16:30:43.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-08T16:30:43.936 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: can't open /var/log/ntpstats/peerstats.20231108: Permission denied 2023-11-08T16:30:43.936 INFO:teuthology.orchestra.run.smithi196.stdout: 8 Nov 16:30:43 ntpd[22895]: ntpd: time slew +0.000358 s 2023-11-08T16:30:43.937 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew +0.000358s 2023-11-08T16:30:43.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-08T16:30:43.937 INFO:teuthology.orchestra.run.smithi196.stderr: 8 Nov 16:30:43 ntpd[22895]: can't open /var/log/ntpstats/loopstats.20231108: Permission denied 2023-11-08T16:30:44.005 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T16:30:44.006 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2023-11-08T16:30:44.006 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T16:30:44.006 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T16:30:44.006 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T16:30:44.007 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-08T16:30:44.008 INFO:teuthology.run_tasks:Running task install... 2023-11-08T16:30:44.017 DEBUG:teuthology.task.install:project ceph 2023-11-08T16:30:44.017 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'}} 2023-11-08T16:30:44.018 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'} 2023-11-08T16:30:44.018 INFO:teuthology.task.install:Using flavor: default 2023-11-08T16:30:44.024 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-08T16:30:44.024 INFO:teuthology.task.install:extra packages: [] 2023-11-08T16:30:44.025 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2023-11-08T16:30:44.130 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-08T16:30:44.190 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-08T16:30:44.191 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2023-11-08T16:30:44.192 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-11-08T16:30:44.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f 2023-11-08T16:30:44.342 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default/ 2023-11-08T16:30:44.343 INFO:teuthology.task.install.deb:Package version is 16.2.14-129-gcfb6fd52-1focal 2023-11-08T16:30:44.520 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:30:44.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-08T16:30:44.537 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2023-11-08T16:30:44.729 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-08T16:30:44.737 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-08T16:30:44.758 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-08T16:30:44.779 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal InRelease 2023-11-08T16:30:44.796 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-08T16:30:44.802 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-11-08T16:30:44.824 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal Release.gpg 2023-11-08T16:30:44.847 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main i386 Packages [3,106 B] 2023-11-08T16:30:44.883 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-11-08T16:30:45.374 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 28.0 kB in 1s (44.1 kB/s) 2023-11-08T16:30:46.412 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:30:46.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.14-129-gcfb6fd52-1focal cephadm=16.2.14-129-gcfb6fd52-1focal ceph-mds=16.2.14-129-gcfb6fd52-1focal ceph-mgr=16.2.14-129-gcfb6fd52-1focal ceph-common=16.2.14-129-gcfb6fd52-1focal ceph-fuse=16.2.14-129-gcfb6fd52-1focal ceph-test=16.2.14-129-gcfb6fd52-1focal radosgw=16.2.14-129-gcfb6fd52-1focal python3-rados=16.2.14-129-gcfb6fd52-1focal python3-rgw=16.2.14-129-gcfb6fd52-1focal python3-cephfs=16.2.14-129-gcfb6fd52-1focal python3-rbd=16.2.14-129-gcfb6fd52-1focal libcephfs2=16.2.14-129-gcfb6fd52-1focal libcephfs-dev=16.2.14-129-gcfb6fd52-1focal librados2=16.2.14-129-gcfb6fd52-1focal librbd1=16.2.14-129-gcfb6fd52-1focal rbd-fuse=16.2.14-129-gcfb6fd52-1focal 2023-11-08T16:30:46.504 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2023-11-08T16:30:46.706 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2023-11-08T16:30:46.707 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2023-11-08T16:30:46.886 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2023-11-08T16:30:46.887 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-08T16:30:46.888 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-08T16:30:46.888 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2023-11-08T16:30:46.888 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-08T16:30:46.889 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-11-08T16:30:46.889 INFO:teuthology.orchestra.run.smithi196.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-11-08T16:30:46.890 INFO:teuthology.orchestra.run.smithi196.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-11-08T16:30:46.890 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-11-08T16:30:46.890 INFO:teuthology.orchestra.run.smithi196.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-11-08T16:30:46.890 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-11-08T16:30:46.890 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-11-08T16:30:46.891 INFO:teuthology.orchestra.run.smithi196.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-08T16:30:46.891 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-08T16:30:46.891 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2023-11-08T16:30:46.891 INFO:teuthology.orchestra.run.smithi196.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-08T16:30:46.891 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-08T16:30:46.892 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-11-08T16:30:46.892 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-11-08T16:30:46.892 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-08T16:30:46.892 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-11-08T16:30:46.892 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-11-08T16:30:46.893 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-11-08T16:30:46.893 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2023-11-08T16:30:46.893 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-08T16:30:46.893 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-08T16:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-08T16:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-08T16:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-08T16:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-08T16:30:46.894 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-08T16:30:46.895 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-08T16:30:46.895 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2023-11-08T16:30:46.895 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2023-11-08T16:30:46.997 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2023-11-08T16:30:46.997 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-08T16:30:46.998 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-08T16:30:46.998 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2023-11-08T16:30:46.998 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2023-11-08T16:30:46.998 INFO:teuthology.orchestra.run.smithi196.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2023-11-08T16:30:46.999 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli 2023-11-08T16:30:46.999 INFO:teuthology.orchestra.run.smithi196.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-11-08T16:30:47.000 INFO:teuthology.orchestra.run.smithi196.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-08T16:30:47.000 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-11-08T16:30:47.000 INFO:teuthology.orchestra.run.smithi196.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-11-08T16:30:47.000 INFO:teuthology.orchestra.run.smithi196.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-11-08T16:30:47.000 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-11-08T16:30:47.001 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-08T16:30:47.001 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-08T16:30:47.001 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-11-08T16:30:47.001 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-11-08T16:30:47.001 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-11-08T16:30:47.002 INFO:teuthology.orchestra.run.smithi196.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-08T16:30:47.002 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-11-08T16:30:47.002 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-11-08T16:30:47.002 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2023-11-08T16:30:47.002 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2023-11-08T16:30:47.003 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 librbd1 2023-11-08T16:30:47.127 INFO:teuthology.orchestra.run.smithi196.stdout:2 upgraded, 98 newly installed, 0 to remove and 255 not upgraded. 2023-11-08T16:30:47.128 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 174 MB of archives. 2023-11-08T16:30:47.128 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 804 MB of additional disk space will be used. 2023-11-08T16:30:47.128 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.14-129-gcfb6fd52-1focal [3,960 B] 2023-11-08T16:30:47.172 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.14-129-gcfb6fd52-1focal [3,384 kB] 2023-11-08T16:30:47.191 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-08T16:30:47.381 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.14-129-gcfb6fd52-1focal [3,391 kB] 2023-11-08T16:30:47.486 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.14-129-gcfb6fd52-1focal [728 kB] 2023-11-08T16:30:47.510 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.14-129-gcfb6fd52-1focal [413 kB] 2023-11-08T16:30:47.523 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.14-129-gcfb6fd52-1focal [22.2 kB] 2023-11-08T16:30:47.524 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.14-129-gcfb6fd52-1focal [212 kB] 2023-11-08T16:30:47.531 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.14-129-gcfb6fd52-1focal [38.5 kB] 2023-11-08T16:30:47.532 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.14-129-gcfb6fd52-1focal [385 kB] 2023-11-08T16:30:47.545 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.14-129-gcfb6fd52-1focal [3,703 kB] 2023-11-08T16:30:47.587 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-08T16:30:47.594 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-08T16:30:47.638 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-08T16:30:47.652 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-08T16:30:47.666 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.14-129-gcfb6fd52-1focal [116 kB] 2023-11-08T16:30:47.670 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.14-129-gcfb6fd52-1focal [448 kB] 2023-11-08T16:30:47.685 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.14-129-gcfb6fd52-1focal [22.7 MB] 2023-11-08T16:30:47.778 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-11-08T16:30:47.800 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-08T16:30:47.808 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-08T16:30:47.839 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-08T16:30:47.844 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-08T16:30:47.846 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-08T16:30:48.026 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-08T16:30:48.194 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-08T16:30:48.223 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-08T16:30:48.247 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-08T16:30:48.363 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-08T16:30:48.376 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-08T16:30:48.381 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-08T16:30:48.499 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-08T16:30:48.500 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-08T16:30:48.501 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.14-129-gcfb6fd52-1focal [5,918 kB] 2023-11-08T16:30:48.502 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-08T16:30:48.525 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-08T16:30:48.624 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.14-129-gcfb6fd52-1focal [204 kB] 2023-11-08T16:30:48.629 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.14-129-gcfb6fd52-1focal [126 kB] 2023-11-08T16:30:48.633 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.14-129-gcfb6fd52-1focal [1,536 kB] 2023-11-08T16:30:48.693 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-08T16:30:48.747 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.14-129-gcfb6fd52-1focal [6,994 kB] 2023-11-08T16:30:48.924 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.14-129-gcfb6fd52-1focal [26.2 MB] 2023-11-08T16:30:49.218 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-08T16:30:49.219 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-08T16:30:49.222 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-08T16:30:49.225 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-08T16:30:49.236 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-08T16:30:49.260 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-08T16:30:49.271 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-08T16:30:49.273 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-08T16:30:49.307 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-08T16:30:49.320 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-08T16:30:49.495 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-08T16:30:49.579 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-08T16:30:49.664 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-08T16:30:49.873 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.14-129-gcfb6fd52-1focal [4,056 B] 2023-11-08T16:30:49.874 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.14-129-gcfb6fd52-1focal [834 kB] 2023-11-08T16:30:49.886 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.14-129-gcfb6fd52-1focal [2,364 kB] 2023-11-08T16:30:49.903 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.14-129-gcfb6fd52-1focal [77.4 kB] 2023-11-08T16:30:49.903 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.14-129-gcfb6fd52-1focal [100 kB] 2023-11-08T16:30:49.904 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.14-129-gcfb6fd52-1focal [2,824 kB] 2023-11-08T16:30:49.987 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.14-129-gcfb6fd52-1focal [7,882 kB] 2023-11-08T16:30:50.246 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.14-129-gcfb6fd52-1focal [4,172 B] 2023-11-08T16:30:50.246 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.14-129-gcfb6fd52-1focal [49.4 MB] 2023-11-08T16:30:50.452 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-08T16:30:50.474 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-08T16:30:50.477 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-08T16:30:50.563 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-08T16:30:50.564 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-08T16:30:50.564 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-08T16:30:50.565 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-08T16:30:50.565 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-08T16:30:50.729 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-08T16:30:50.812 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-08T16:30:50.991 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-08T16:30:51.007 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-08T16:30:51.039 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-08T16:30:51.169 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-08T16:30:51.204 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-08T16:30:51.227 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-08T16:30:51.236 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-08T16:30:51.279 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-08T16:30:51.305 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-08T16:30:51.492 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-08T16:30:51.575 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-08T16:30:51.677 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-08T16:30:51.700 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-08T16:30:51.813 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-08T16:30:52.077 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.14-129-gcfb6fd52-1focal [21.5 kB] 2023-11-08T16:30:52.078 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.14-129-gcfb6fd52-1focal [11.3 MB] 2023-11-08T16:30:52.099 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-08T16:30:52.100 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-08T16:30:52.105 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-08T16:30:52.105 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-08T16:30:52.116 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-08T16:30:52.120 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-08T16:30:52.285 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-08T16:30:52.329 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-11-07-0801-pacific/cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.14-129-gcfb6fd52-1focal [78.3 kB] 2023-11-08T16:30:52.452 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-08T16:30:52.704 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-08T16:30:53.368 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 174 MB in 6s (30.3 MB/s) 2023-11-08T16:30:53.464 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjaeger. 2023-11-08T16:30:53.520 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141730 files and directories currently installed.) 2023-11-08T16:30:53.524 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-libjaeger_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:53.605 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjaeger (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:53.923 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-08T16:30:53.942 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-08T16:30:54.024 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T16:30:54.353 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-librbd1_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:54.461 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (16.2.14-129-gcfb6fd52-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T16:30:55.149 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-librados2_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:55.273 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (16.2.14-129-gcfb6fd52-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-08T16:30:55.944 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2023-11-08T16:30:55.960 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libcephfs2_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:56.002 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:56.321 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2023-11-08T16:30:56.338 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-python3-rados_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:56.379 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:56.732 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-08T16:30:56.752 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-python3-ceph-argparse_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:30:56.790 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:57.118 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2023-11-08T16:30:57.134 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-python3-cephfs_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:57.176 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:57.504 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-08T16:30:57.521 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-python3-ceph-common_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:30:57.562 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:57.882 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2023-11-08T16:30:57.898 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2023-11-08T16:30:57.932 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-08T16:30:58.151 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2023-11-08T16:30:58.169 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-python3-rbd_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:58.243 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:30:58.560 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-08T16:30:58.575 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-08T16:30:58.618 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T16:30:58.958 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-08T16:30:58.976 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-08T16:30:59.008 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T16:30:59.308 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-08T16:30:59.324 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-08T16:30:59.383 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T16:30:59.711 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2023-11-08T16:30:59.728 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-librgw2_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:30:59.769 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:00.363 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2023-11-08T16:31:00.379 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-python3-rgw_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:00.421 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:00.766 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-11-08T16:31:00.783 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-11-08T16:31:00.824 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-11-08T16:31:01.177 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0. 2023-11-08T16:31:01.194 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-08T16:31:01.235 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-08T16:31:01.555 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2023-11-08T16:31:01.571 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libradosstriper1_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:01.613 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:02.092 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2023-11-08T16:31:02.107 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-ceph-common_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:02.141 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:04.330 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2023-11-08T16:31:04.346 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-ceph-base_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:04.390 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:05.310 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cryptography. 2023-11-08T16:31:05.329 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-08T16:31:05.368 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T16:31:05.672 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2023-11-08T16:31:05.700 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-08T16:31:05.755 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-08T16:31:05.999 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-08T16:31:06.015 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:31:06.057 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:06.454 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-08T16:31:06.470 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-08T16:31:06.513 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T16:31:06.824 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-08T16:31:06.844 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-08T16:31:06.907 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-08T16:31:07.229 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jwt. 2023-11-08T16:31:07.248 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-08T16:31:07.287 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T16:31:07.599 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2023-11-08T16:31:07.615 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-python3-logutils_0.3.3-7_all.deb ... 2023-11-08T16:31:07.649 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-08T16:31:07.876 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-08T16:31:07.896 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-08T16:31:07.934 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-08T16:31:08.271 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2023-11-08T16:31:08.289 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-08T16:31:08.329 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T16:31:08.674 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-08T16:31:08.690 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-08T16:31:08.732 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-08T16:31:09.026 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-08T16:31:09.045 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-08T16:31:09.084 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T16:31:09.388 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2023-11-08T16:31:09.408 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-08T16:31:09.446 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-08T16:31:09.791 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-08T16:31:09.809 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-08T16:31:09.849 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T16:31:10.143 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bs4. 2023-11-08T16:31:10.161 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-python3-bs4_4.8.2-1_all.deb ... 2023-11-08T16:31:10.201 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-08T16:31:10.580 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2023-11-08T16:31:10.598 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../35-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-08T16:31:10.642 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T16:31:11.007 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2023-11-08T16:31:11.027 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../36-python3-tempita_0.5.2-6_all.deb ... 2023-11-08T16:31:11.066 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-08T16:31:11.368 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2023-11-08T16:31:11.388 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../37-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-08T16:31:11.427 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T16:31:11.747 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-08T16:31:11.763 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-08T16:31:11.805 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T16:31:12.141 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-08T16:31:12.157 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../39-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-08T16:31:12.199 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-08T16:31:12.502 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2023-11-08T16:31:12.518 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../40-python3-webtest_2.0.32-2_all.deb ... 2023-11-08T16:31:12.560 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-08T16:31:12.897 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2023-11-08T16:31:12.914 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../41-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-08T16:31:12.955 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T16:31:13.318 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-08T16:31:13.337 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../42-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-08T16:31:13.376 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T16:31:13.705 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-08T16:31:13.724 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../43-libsqlite3-mod-ceph_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:13.762 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:14.132 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2023-11-08T16:31:14.150 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../44-ceph-mgr_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:14.190 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:14.694 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2023-11-08T16:31:14.710 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../45-ceph-mon_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:14.752 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:15.856 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2023-11-08T16:31:15.876 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../46-ceph-osd_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:15.914 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:18.502 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2023-11-08T16:31:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../47-ceph_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:18.560 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:19.531 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2023-11-08T16:31:19.547 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../48-ceph-fuse_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:19.588 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:20.025 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2023-11-08T16:31:20.042 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../49-ceph-mds_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:20.083 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:20.586 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2023-11-08T16:31:20.602 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../50-cephadm_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:20.636 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:20.914 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2023-11-08T16:31:20.931 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../51-python3-jinja2_2.10.1-2_all.deb ... 2023-11-08T16:31:20.972 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-08T16:31:21.284 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-08T16:31:21.303 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../52-ceph-mgr-cephadm_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:31:21.342 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:21.687 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-08T16:31:21.703 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../53-python3-repoze.lru_0.7-2_all.deb ... 2023-11-08T16:31:21.745 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-08T16:31:22.031 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjs-underscore. 2023-11-08T16:31:22.047 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../54-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-08T16:31:22.089 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T16:31:22.366 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-08T16:31:22.385 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../55-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-08T16:31:22.424 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T16:31:22.769 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2023-11-08T16:31:22.786 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../56-python3-routes_2.4.1-2_all.deb ... 2023-11-08T16:31:22.826 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-08T16:31:23.188 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-08T16:31:23.206 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../57-ceph-mgr-dashboard_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:31:23.246 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:24.204 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-decorator. 2023-11-08T16:31:24.221 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../58-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-08T16:31:24.262 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T16:31:24.641 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-08T16:31:24.658 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../59-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-08T16:31:24.698 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T16:31:25.034 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-scipy. 2023-11-08T16:31:25.052 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../60-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-08T16:31:25.092 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-08T16:31:26.402 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-08T16:31:26.418 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../61-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-08T16:31:26.459 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T16:31:27.047 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2023-11-08T16:31:27.063 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../62-python3-joblib_0.14.0-3_all.deb ... 2023-11-08T16:31:27.104 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-08T16:31:27.466 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2023-11-08T16:31:27.485 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../63-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-08T16:31:27.524 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T16:31:28.208 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-08T16:31:28.226 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../64-ceph-mgr-diskprediction-local_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:31:28.266 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:29.411 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2023-11-08T16:31:29.428 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../65-python3-cachetools_4.0.0-1_all.deb ... 2023-11-08T16:31:29.469 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-08T16:31:29.780 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-08T16:31:29.798 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../66-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-08T16:31:29.838 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T16:31:30.125 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-08T16:31:30.145 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../67-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-08T16:31:30.174 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T16:31:30.461 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2023-11-08T16:31:30.478 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../68-python3-rsa_4.0-3_all.deb ... 2023-11-08T16:31:30.510 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-08T16:31:30.831 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2023-11-08T16:31:30.847 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../69-python3-google-auth_1.5.1-2_all.deb ... 2023-11-08T16:31:30.905 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-08T16:31:31.208 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-blinker. 2023-11-08T16:31:31.228 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../70-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-08T16:31:31.266 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T16:31:31.603 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-08T16:31:31.619 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../71-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-08T16:31:31.661 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T16:31:31.973 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-08T16:31:31.993 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../72-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-08T16:31:32.056 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T16:31:32.350 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2023-11-08T16:31:32.367 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../73-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-08T16:31:32.408 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T16:31:32.736 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-08T16:31:32.752 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../74-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-08T16:31:32.794 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T16:31:33.366 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-08T16:31:33.383 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../75-ceph-mgr-k8sevents_16.2.14-129-gcfb6fd52-1focal_all.deb ... 2023-11-08T16:31:33.424 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:33.726 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-08T16:31:33.743 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../76-libonig5_6.9.4-1_amd64.deb ... 2023-11-08T16:31:33.801 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-08T16:31:34.146 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-08T16:31:34.165 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../77-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T16:31:34.204 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T16:31:34.532 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2023-11-08T16:31:34.548 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../78-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-08T16:31:34.590 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T16:31:35.243 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2023-11-08T16:31:35.260 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../79-socat_1.7.3.3-2_amd64.deb ... 2023-11-08T16:31:35.301 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-08T16:31:35.629 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2023-11-08T16:31:35.646 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../80-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-08T16:31:35.687 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-08T16:31:36.110 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2023-11-08T16:31:36.128 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../81-ceph-test_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:36.177 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:40.364 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-08T16:31:40.383 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../82-libcephfs-dev_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:40.422 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:40.825 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2023-11-08T16:31:40.845 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../83-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-08T16:31:40.900 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T16:31:41.256 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-08T16:31:41.272 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-08T16:31:41.338 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T16:31:41.608 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-attr. 2023-11-08T16:31:41.624 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2023-11-08T16:31:41.666 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-08T16:31:41.994 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webencodings. 2023-11-08T16:31:42.011 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-08T16:31:42.052 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T16:31:42.355 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-html5lib. 2023-11-08T16:31:42.371 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2023-11-08T16:31:42.413 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-08T16:31:42.774 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-08T16:31:42.791 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-08T16:31:42.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T16:31:43.328 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-packaging. 2023-11-08T16:31:43.349 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2023-11-08T16:31:43.386 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-08T16:31:43.722 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2023-11-08T16:31:43.739 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2023-11-08T16:31:43.782 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-08T16:31:44.104 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2023-11-08T16:31:44.121 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2023-11-08T16:31:44.164 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-08T16:31:44.509 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2023-11-08T16:31:44.525 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-08T16:31:44.567 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T16:31:44.919 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2023-11-08T16:31:44.937 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../93-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-08T16:31:44.977 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T16:31:45.288 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-08T16:31:45.309 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-08T16:31:45.346 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T16:31:45.683 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-08T16:31:45.699 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../95-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-08T16:31:45.741 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T16:31:46.077 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2023-11-08T16:31:46.094 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../96-python3-pytest_4.6.9-1_all.deb ... 2023-11-08T16:31:46.135 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-08T16:31:46.464 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2023-11-08T16:31:46.481 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../97-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-08T16:31:46.522 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T16:31:46.967 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2023-11-08T16:31:46.986 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../98-radosgw_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:47.026 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:48.220 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2023-11-08T16:31:48.237 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../99-rbd-fuse_16.2.14-129-gcfb6fd52-1focal_amd64.deb ... 2023-11-08T16:31:48.303 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:48.617 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-08T16:31:48.908 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-11-08T16:31:49.034 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-08T16:31:49.160 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-08T16:31:49.353 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:50.053 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2023-11-08T16:31:50.209 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-08T16:31:50.561 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-08T16:31:50.870 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-08T16:31:50.996 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-08T16:31:51.323 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-08T16:31:51.725 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-08T16:31:52.051 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-08T16:31:52.335 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-08T16:31:52.646 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-08T16:31:52.980 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:53.282 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-08T16:31:53.408 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-08T16:31:53.700 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-08T16:31:53.993 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-08T16:31:54.369 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-08T16:31:54.645 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-08T16:31:55.021 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-08T16:31:55.306 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjaeger (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:55.432 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-08T16:31:55.766 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-08T16:31:56.101 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-08T16:31:56.394 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-08T16:31:56.544 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-08T16:31:56.821 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-08T16:31:57.222 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-08T16:31:57.582 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-08T16:31:57.967 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-08T16:31:58.093 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:31:58.428 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-08T16:31:58.779 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-08T16:31:58.905 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-08T16:31:59.039 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-08T16:31:59.357 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-08T16:31:59.667 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-08T16:31:59.793 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-08T16:32:00.119 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-08T16:32:00.379 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-08T16:32:00.673 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-08T16:32:00.806 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-08T16:32:01.115 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-08T16:32:01.408 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-08T16:32:01.734 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-08T16:32:02.147 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-08T16:32:02.386 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-08T16:32:02.522 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-08T16:32:02.848 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-08T16:32:03.199 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-08T16:32:03.325 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-08T16:32:03.460 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-08T16:32:03.786 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-08T16:32:04.070 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:04.196 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-08T16:32:05.686 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:05.812 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:05.938 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-08T16:32:06.581 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-08T16:32:06.957 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-08T16:32:07.253 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-08T16:32:07.554 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-08T16:32:07.897 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:08.040 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-08T16:32:08.383 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:08.493 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-08T16:32:08.844 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-08T16:32:09.883 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:10.001 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-08T16:32:10.127 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-08T16:32:10.253 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-08T16:32:10.587 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-08T16:32:10.897 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:11.048 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:11.272 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T16:32:11.272 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-08T16:32:11.770 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:11.895 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-08T16:32:12.188 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-08T16:32:12.499 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-08T16:32:12.869 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:12.993 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:13.119 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:13.272 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-08T16:32:13.582 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-08T16:32:13.969 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:14.095 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:14.413 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-08T16:32:15.350 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:15.886 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2023-11-08T16:32:16.271 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2023-11-08T16:32:16.447 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2023-11-08T16:32:16.472 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-08T16:32:16.613 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-08T16:32:16.924 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-08T16:32:17.376 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:17.502 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:17.786 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T16:32:17.786 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-08T16:32:18.473 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:18.834 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-08T16:32:19.299 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:19.519 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T16:32:19.519 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-08T16:32:19.968 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:20.200 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T16:32:20.200 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-08T16:32:20.688 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:21.209 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T16:32:21.209 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-08T16:32:21.657 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:21.783 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:22.251 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:22.479 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T16:32:22.479 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-08T16:32:22.946 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:23.090 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:23.241 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (16.2.14-129-gcfb6fd52-1focal) ... 2023-11-08T16:32:23.377 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-08T16:32:23.677 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-08T16:32:26.464 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-08T16:32:26.942 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-08T16:32:26.945 DEBUG:teuthology.parallel:result is None 2023-11-08T16:32:26.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f 2023-11-08T16:32:27.093 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2023-11-08T16:32:27.116 INFO:teuthology.orchestra.run.smithi196.stdout:16.2.14-129-gcfb6fd52-1focal 2023-11-08T16:32:27.117 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-129-gcfb6fd52-1focal 2023-11-08T16:32:27.117 INFO:teuthology.task.install:The correct ceph version 16.2.14-129-gcfb6fd52-1focal is installed. 2023-11-08T16:32:27.118 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-08T16:32:27.118 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.119 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-08T16:32:27.173 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-08T16:32:27.173 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.174 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2023-11-08T16:32:27.185 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-08T16:32:27.199 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-08T16:32:27.200 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-08T16:32:27.213 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-08T16:32:27.269 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-08T16:32:27.270 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.270 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2023-11-08T16:32:27.280 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-08T16:32:27.296 INFO:teuthology.run_tasks:Running task ceph... 2023-11-08T16:32:27.368 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-08T16:32:27.369 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2023-11-08T16:32:27.385 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-08T16:32:27.386 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-08T16:32:27.395 INFO:tasks.ceph:Creating extra log directories... 2023-11-08T16:32:27.395 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-08T16:32:27.463 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-08T16:32:27.464 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-08T16:32:27.464 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000', 'branch': 'wip-yuri3-testing-2023-11-07-0801-pacific', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic}', 'email': None, 'first_in_suite': False, 'job_id': '7452000', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-11-07-0801-pacific'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-11-07-0801-pacific', 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9776, 'sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri3-testing-2023-11-07-0801-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f', 'targets': {'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-08_16:13:26', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3590714'} 2023-11-08T16:32:27.465 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-08T16:32:27.471 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2023-11-08T16:32:27.530 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.531 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2023-11-08T16:32:27.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-08T16:32:27.536 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2023-11-08T16:32:27.544 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-08T16:32:27.544 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T16:32:27.544 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-11-08T16:32:27.544 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T16:32:27.545 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-11-08 16:29:04.233876423 +0000 2023-11-08T16:32:27.545 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-11-08 16:29:03.933883339 +0000 2023-11-08T16:32:27.545 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-11-08 16:29:03.933883339 +0000 2023-11-08T16:32:27.545 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-11-08T16:32:27.545 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-08T16:32:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-11-08T16:32:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-11-08T16:32:27.601 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000395861 s, 1.3 MB/s 2023-11-08T16:32:27.602 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-08T16:32:27.609 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2023-11-08T16:32:27.615 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-08T16:32:27.615 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T16:32:27.615 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-11-08T16:32:27.615 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T16:32:27.616 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-11-08 16:29:04.721865176 +0000 2023-11-08T16:32:27.616 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-11-08 16:29:04.425871998 +0000 2023-11-08T16:32:27.616 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-11-08 16:29:04.425871998 +0000 2023-11-08T16:32:27.616 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-11-08T16:32:27.617 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-08T16:32:27.673 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-11-08T16:32:27.673 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-11-08T16:32:27.673 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000396537 s, 1.3 MB/s 2023-11-08T16:32:27.674 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-08T16:32:27.682 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2023-11-08T16:32:27.687 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-08T16:32:27.688 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T16:32:27.688 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-11-08T16:32:27.688 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T16:32:27.688 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-11-08 16:29:05.225853559 +0000 2023-11-08T16:32:27.688 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-11-08 16:29:04.945860012 +0000 2023-11-08T16:32:27.689 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-11-08 16:29:04.945860012 +0000 2023-11-08T16:32:27.689 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-11-08T16:32:27.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-08T16:32:27.745 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-11-08T16:32:27.746 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-11-08T16:32:27.746 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000392061 s, 1.3 MB/s 2023-11-08T16:32:27.747 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-08T16:32:27.754 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2023-11-08T16:32:27.760 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-08T16:32:27.761 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-08T16:32:27.761 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-11-08T16:32:27.761 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-08T16:32:27.761 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2023-11-08 16:29:05.737841758 +0000 2023-11-08T16:32:27.762 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2023-11-08 16:29:05.461848118 +0000 2023-11-08T16:32:27.762 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2023-11-08 16:29:05.461848118 +0000 2023-11-08T16:32:27.762 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2023-11-08T16:32:27.763 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-08T16:32:27.816 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2023-11-08T16:32:27.816 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2023-11-08T16:32:27.817 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000407971 s, 1.3 MB/s 2023-11-08T16:32:27.818 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-08T16:32:27.827 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-11-08T16:32:27.827 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-11-08T16:32:27.827 INFO:tasks.ceph:Generating config... 2023-11-08T16:32:27.829 INFO:tasks.ceph:[client] rbd default format = 1 2023-11-08T16:32:27.829 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-11-08T16:32:27.829 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-11-08T16:32:27.830 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-08T16:32:27.830 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-08T16:32:27.830 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-08T16:32:27.830 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-08T16:32:27.831 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-08T16:32:27.831 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-08T16:32:27.831 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-08T16:32:27.831 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-11-08T16:32:27.832 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-08T16:32:27.832 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-08T16:32:27.832 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-08T16:32:27.832 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-08T16:32:27.833 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-08T16:32:27.833 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-08T16:32:27.833 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-08T16:32:27.834 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-08T16:32:27.834 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-08T16:32:27.834 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-08T16:32:27.834 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-08T16:32:27.835 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-08T16:32:27.835 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-11-08T16:32:27.835 INFO:tasks.ceph:Setting up mon.a... 2023-11-08T16:32:27.836 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-08T16:32:27.881 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.keyring 2023-11-08T16:32:27.884 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-08T16:32:27.964 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T16:32:27.974 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.196')] 2023-11-08T16:32:27.975 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.196', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2023-11-08T16:32:27.976 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:27.976 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T16:32:27.982 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.196 --print /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:28.055 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:28.056 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: generated fsid c8f9847b-e808-4c51-aead-8d5627003eba 2023-11-08T16:32:28.056 INFO:teuthology.orchestra.run.smithi196.stdout:epoch 0 2023-11-08T16:32:28.056 INFO:teuthology.orchestra.run.smithi196.stdout:fsid c8f9847b-e808-4c51-aead-8d5627003eba 2023-11-08T16:32:28.056 INFO:teuthology.orchestra.run.smithi196.stdout:last_changed 2023-11-08T16:32:28.054110+0000 2023-11-08T16:32:28.057 INFO:teuthology.orchestra.run.smithi196.stdout:created 2023-11-08T16:32:28.054110+0000 2023-11-08T16:32:28.057 INFO:teuthology.orchestra.run.smithi196.stdout:min_mon_release 0 (unknown) 2023-11-08T16:32:28.057 INFO:teuthology.orchestra.run.smithi196.stdout:election_strategy: 1 2023-11-08T16:32:28.057 INFO:teuthology.orchestra.run.smithi196.stdout:0: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.a 2023-11-08T16:32:28.058 INFO:teuthology.orchestra.run.smithi196.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-11-08T16:32:28.059 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-08T16:32:28.063 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8f9847b-e808-4c51-aead-8d5627003eba... 2023-11-08T16:32:28.064 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-08T16:32:28.098 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2023-11-08T16:32:28.099 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2023-11-08T16:32:28.099 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-08T16:32:28.099 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2023-11-08T16:32:28.099 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2023-11-08T16:32:28.100 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2023-11-08T16:32:28.101 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.101 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2023-11-08T16:32:28.101 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2023-11-08T16:32:28.101 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.101 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-08T16:32:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2023-11-08T16:32:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2023-11-08T16:32:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-08T16:32:28.102 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.103 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2023-11-08T16:32:28.103 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.103 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2023-11-08T16:32:28.103 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2023-11-08T16:32:28.103 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2023-11-08T16:32:28.104 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2023-11-08T16:32:28.104 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2023-11-08T16:32:28.104 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2023-11-08T16:32:28.104 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2023-11-08T16:32:28.104 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-08T16:32:28.105 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-08T16:32:28.105 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2023-11-08T16:32:28.105 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.105 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-11-08T16:32:28.105 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.106 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2023-11-08T16:32:28.106 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.106 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2023-11-08T16:32:28.106 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.106 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2023-11-08T16:32:28.107 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2023-11-08T16:32:28.107 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2023-11-08T16:32:28.107 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = 172.21.15.196 2023-11-08T16:32:28.107 INFO:teuthology.orchestra.run.smithi196.stdout: mon client directed command retry = 5 2023-11-08T16:32:28.107 INFO:teuthology.orchestra.run.smithi196.stdout: ms inject socket failures = 5000 2023-11-08T16:32:28.108 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = c8f9847b-e808-4c51-aead-8d5627003eba 2023-11-08T16:32:28.108 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.108 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2023-11-08T16:32:28.108 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2023-11-08T16:32:28.108 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.109 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2023-11-08T16:32:28.109 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2023-11-08T16:32:28.109 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.109 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2023-11-08T16:32:28.109 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2023-11-08T16:32:28.110 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.110 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2023-11-08T16:32:28.110 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2023-11-08T16:32:28.110 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2023-11-08T16:32:28.110 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.111 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2023-11-08T16:32:28.112 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.112 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2023-11-08T16:32:28.112 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.112 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2023-11-08T16:32:28.112 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2023-11-08T16:32:28.113 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.113 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2023-11-08T16:32:28.113 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2023-11-08T16:32:28.113 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2023-11-08T16:32:28.113 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = stupid 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2023-11-08T16:32:28.114 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-11-08T16:32:28.115 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2023-11-08T16:32:28.115 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2023-11-08T16:32:28.115 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2023-11-08T16:32:28.115 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2023-11-08T16:32:28.115 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2023-11-08T16:32:28.116 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2023-11-08T16:32:28.116 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2023-11-08T16:32:28.116 INFO:teuthology.orchestra.run.smithi196.stdout: osd shutdown pgref assert = True 2023-11-08T16:32:28.116 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.116 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-11-08T16:32:28.117 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-11-08T16:32:28.118 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2023-11-08T16:32:28.118 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.118 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2023-11-08T16:32:28.118 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2023-11-08T16:32:28.119 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2023-11-08T16:32:28.119 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2023-11-08T16:32:28.119 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2023-11-08T16:32:28.119 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2023-11-08T16:32:28.119 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2023-11-08T16:32:28.120 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2023-11-08T16:32:28.120 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2023-11-08T16:32:28.120 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2023-11-08T16:32:28.120 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2023-11-08T16:32:28.120 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2023-11-08T16:32:28.121 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-08T16:32:28.122 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-08T16:32:28.122 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:28.122 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2023-11-08T16:32:28.122 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2023-11-08T16:32:28.122 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2023-11-08T16:32:28.123 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2023-11-08T16:32:28.123 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-08T16:32:28.123 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-08T16:32:28.123 INFO:teuthology.orchestra.run.smithi196.stdout: rbd default format = 1 2023-11-08T16:32:28.123 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2023-11-08T16:32:28.124 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-08T16:32:28.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-08T16:32:28.215 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-08T16:32:28.216 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:28.216 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-08T16:32:28.222 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:28.223 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-08T16:32:28.270 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:32:28.270 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:28.270 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-08T16:32:28.271 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-08T16:32:28.297 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:28.297 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:28.304 INFO:tasks.ceph:Setting up mon nodes... 2023-11-08T16:32:28.304 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-08T16:32:28.305 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T16:32:28.391 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-08T16:32:28.393 INFO:tasks.ceph:Setting up mds nodes... 2023-11-08T16:32:28.394 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-08T16:32:28.394 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-08T16:32:28.427 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-08T16:32:28.439 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-08T16:32:28.439 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-11-08T16:32:28.439 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-08T16:32:28.455 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-11-08T16:32:28.455 INFO:tasks.ceph:role: osd.0 2023-11-08T16:32:28.455 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:32:28.456 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-08T16:32:29.017 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T16:32:29.017 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T16:32:29.018 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T16:32:29.018 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-11-08T16:32:29.018 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T16:32:29.018 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-11-08T16:32:29.019 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T16:32:29.019 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T16:32:29.019 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T16:32:29.019 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T16:32:29.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-11-08T16:32:29.020 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-08T16:32:29.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-08T16:32:29.106 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T16:32:29.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T16:32:29.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-08T16:32:29.124 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-11-08T16:32:29.124 INFO:tasks.ceph:role: osd.1 2023-11-08T16:32:29.125 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:32:29.125 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-08T16:32:29.703 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T16:32:29.703 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T16:32:29.703 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T16:32:29.704 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-11-08T16:32:29.704 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T16:32:29.704 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-11-08T16:32:29.704 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T16:32:29.705 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T16:32:29.705 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T16:32:29.705 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T16:32:29.706 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-11-08T16:32:29.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-08T16:32:29.744 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-08T16:32:29.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T16:32:29.755 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T16:32:29.755 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-08T16:32:29.766 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-11-08T16:32:29.766 INFO:tasks.ceph:role: osd.2 2023-11-08T16:32:29.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:32:29.767 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-08T16:32:30.283 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-08T16:32:30.284 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-08T16:32:30.284 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-08T16:32:30.284 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 2023-11-08T16:32:30.284 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-08T16:32:30.285 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2023-11-08T16:32:30.285 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-08T16:32:30.285 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-08T16:32:30.285 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-08T16:32:30.285 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-08T16:32:30.286 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2023-11-08T16:32:30.287 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-08T16:32:30.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-08T16:32:30.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T16:32:30.353 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2023-11-08T16:32:30.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:30.468 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-08T16:32:30.469 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-08T16:32:30.469 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T16:32:30.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T16:32:30.470 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-08T16:32:30.471 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:30.465+0000 7f6e5689d200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-08T16:32:33.435 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-08T16:32:33.450 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:33.531 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-08T16:32:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-08T16:32:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T16:32:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T16:32:33.532 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-08T16:32:33.533 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:33.529+0000 7f6848928200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-08T16:32:36.515 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-08T16:32:36.531 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:36.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.561+0000 7f8ddbb27200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-08T16:32:36.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.561+0000 7f8ddbb27200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-08T16:32:36.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.561+0000 7f8ddbb27200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T16:32:36.567 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.561+0000 7f8ddbb27200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T16:32:36.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.561+0000 7f8ddbb27200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-08T16:32:36.568 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T16:32:36.565+0000 7f8ddbb27200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-08T16:32:39.550 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-08T16:32:39.607 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-08T16:32:39.607 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:39.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-08T16:32:39.618 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:39.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-08T16:32:39.628 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:39.629 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-08T16:32:39.684 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:39.684 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-08T16:32:39.700 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:39.700 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-08T16:32:39.707 INFO:tasks.ceph:Adding keys to all mons... 2023-11-08T16:32:39.707 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-08T16:32:39.765 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2023-11-08T16:32:39.765 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAcuEtlmNc+FxAAafRv3zndG5/ODTzCM1NqBA== 2023-11-08T16:32:39.765 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2023-11-08T16:32:39.765 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAeuEtl8c3LGxAAR8Q79esKJ77Jg5k5SOjjyg== 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAhuEtl/mqUHxAAvaL3ykQR9w9bEexskmKipA== 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAkuEtlmDKrIRAAh6ztk491MtMoT4GuHg9fdA== 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2023-11-08T16:32:39.766 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQAcuEtl6v5eGRAAQTgyBwwhfsm6cGNrlqzC0A== 2023-11-08T16:32:39.767 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-08T16:32:39.804 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T16:32:39.847 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T16:32:39.884 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-08T16:32:39.971 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-08T16:32:40.019 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-08T16:32:40.020 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-08T16:32:40.034 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-08T16:32:40.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-08T16:32:40.149 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-08T16:32:40.155 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-08T16:32:40.155 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-08T16:32:40.156 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-08T16:32:40.158 INFO:tasks.ceph.mon.a:Started 2023-11-08T16:32:40.158 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-08T16:32:40.159 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-08T16:32:40.159 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-08T16:32:40.161 INFO:tasks.ceph.mgr.x:Started 2023-11-08T16:32:40.162 INFO:tasks.ceph:Setting crush tunables to default 2023-11-08T16:32:40.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd crush tunables default 2023-11-08T16:32:40.410 INFO:teuthology.orchestra.run.smithi196.stderr:adjusted tunables profile to default 2023-11-08T16:32:40.421 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-08T16:32:40.421 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:40.421 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-08T16:32:40.432 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:40.432 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-08T16:32:40.448 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:32:40.448 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-08T16:32:40.462 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new adb5d5a9-dc78-44db-88ba-8e6dcb79b089 0 2023-11-08T16:32:40.566 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:40.561+0000 7f07667e1500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-08T16:32:40.627 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:40.621+0000 7f07667e1500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-08T16:32:40.660 INFO:teuthology.orchestra.run.smithi196.stdout:0 2023-11-08T16:32:40.676 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new f44c220f-6fb3-4482-8dd8-59b1829550bd 1 2023-11-08T16:32:40.871 INFO:teuthology.orchestra.run.smithi196.stdout:1 2023-11-08T16:32:40.883 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 6829c900-d6ff-4ed8-aebf-b6d0538176ad 2 2023-11-08T16:32:41.075 INFO:teuthology.orchestra.run.smithi196.stdout:2 2023-11-08T16:32:41.090 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-08T16:32:41.091 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-08T16:32:41.093 INFO:tasks.ceph.osd.0:Started 2023-11-08T16:32:41.093 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-08T16:32:41.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-08T16:32:41.095 INFO:tasks.ceph.osd.1:Started 2023-11-08T16:32:41.096 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-08T16:32:41.096 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-08T16:32:41.098 INFO:tasks.ceph.osd.2:Started 2023-11-08T16:32:41.099 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T16:32:41.278 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:41.278 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":5,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T16:32:41.070327+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T16:32:41.290 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-08T16:32:41.290 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-08T16:32:41.296 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:41.293+0000 7f07667e1500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-08T16:32:41.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:32:41.441+0000 7f71e851d200 -1 Falling back to public interface 2023-11-08T16:32:41.593 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T16:32:41.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:32:41.721+0000 7f0410618200 -1 Falling back to public interface 2023-11-08T16:32:41.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:32:41.729+0000 7f0a21909200 -1 Falling back to public interface 2023-11-08T16:32:41.764 INFO:teuthology.misc.health.smithi196.stdout: 2023-11-08T16:32:41.764 INFO:teuthology.misc.health.smithi196.stdout:{"epoch":5,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T16:32:41.070327+0000","last_up_change":"0.000000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T16:32:41.774 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-11-08T16:32:41.877 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:41.873+0000 7f07667e1500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-08T16:32:42.030 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.025+0000 7f07667e1500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-08T16:32:42.246 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.241+0000 7f07667e1500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-08T16:32:42.400 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.397+0000 7f07667e1500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-08T16:32:42.449 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.445+0000 7f07667e1500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-08T16:32:42.509 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.505+0000 7f07667e1500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-08T16:32:42.562 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.557+0000 7f07667e1500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-08T16:32:42.850 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:42.845+0000 7f07667e1500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-08T16:32:43.090 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.085+0000 7f07667e1500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-08T16:32:43.334 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.329+0000 7f07667e1500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-08T16:32:43.397 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.393+0000 7f07667e1500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-08T16:32:43.624 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.621+0000 7f07667e1500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-08T16:32:43.682 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.677+0000 7f07667e1500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-08T16:32:43.824 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.821+0000 7f07667e1500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-08T16:32:43.917 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:43.913+0000 7f07667e1500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-08T16:32:44.050 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:44.045+0000 7f07667e1500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-08T16:32:44.243 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:44.241+0000 7f07667e1500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-08T16:32:45.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:32:45.277+0000 7f71e851d200 -1 osd.0 0 log_to_monitors {default=true} 2023-11-08T16:32:45.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:32:45.385+0000 7f0a21909200 -1 osd.1 0 log_to_monitors {default=true} 2023-11-08T16:32:45.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:32:45.541+0000 7f0410618200 -1 osd.2 0 log_to_monitors {default=true} 2023-11-08T16:32:46.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:32:46.261+0000 7f0a1e8ce700 -1 osd.1 0 waiting for initial osdmap 2023-11-08T16:32:46.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:32:46.265+0000 7f0a19e1d700 -1 osd.1 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T16:32:47.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:32:47.269+0000 7f040bdb8700 -1 osd.2 0 waiting for initial osdmap 2023-11-08T16:32:47.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:32:47.269+0000 7f71e54e2700 -1 osd.0 0 waiting for initial osdmap 2023-11-08T16:32:47.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:32:47.273+0000 7f0408b2c700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T16:32:47.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:32:47.273+0000 7f71e0a31700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-08T16:32:47.298 INFO:tasks.ceph.mgr.x.smithi196.stderr:2023-11-08T16:32:47.293+0000 7f07504c3700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-11-08T16:32:48.077 DEBUG:teuthology.orchestra.run.smithi196:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-08T16:32:48.346 INFO:teuthology.misc.health.smithi196.stdout: 2023-11-08T16:32:48.347 INFO:teuthology.misc.health.smithi196.stdout:{"epoch":8,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T16:32:48.264488+0000","last_up_change":"2023-11-08T16:32:48.264488+0000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":30123},{"type":"v1","addr":"172.21.15.196:6801","nonce":30123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":30123},{"type":"v1","addr":"172.21.15.196:6803","nonce":30123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":30123},{"type":"v1","addr":"172.21.15.196:6807","nonce":30123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":30123},{"type":"v1","addr":"172.21.15.196:6805","nonce":30123}]},"public_addr":"172.21.15.196:6801/30123","cluster_addr":"172.21.15.196:6803/30123","heartbeat_back_addr":"172.21.15.196:6807/30123","heartbeat_front_addr":"172.21.15.196:6805/30123","state":["exists","up"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":30124},{"type":"v1","addr":"172.21.15.196:6817","nonce":30124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":30124},{"type":"v1","addr":"172.21.15.196:6819","nonce":30124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":30124},{"type":"v1","addr":"172.21.15.196:6823","nonce":30124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":30124},{"type":"v1","addr":"172.21.15.196:6821","nonce":30124}]},"public_addr":"172.21.15.196:6817/30124","cluster_addr":"172.21.15.196:6819/30124","heartbeat_back_addr":"172.21.15.196:6823/30124","heartbeat_front_addr":"172.21.15.196:6821/30124","state":["exists","up"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":30125},{"type":"v1","addr":"172.21.15.196:6809","nonce":30125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":30125},{"type":"v1","addr":"172.21.15.196:6811","nonce":30125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":30125},{"type":"v1","addr":"172.21.15.196:6815","nonce":30125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":30125},{"type":"v1","addr":"172.21.15.196:6813","nonce":30125}]},"public_addr":"172.21.15.196:6809/30125","cluster_addr":"172.21.15.196:6811/30125","heartbeat_back_addr":"172.21.15.196:6815/30125","heartbeat_front_addr":"172.21.15.196:6813/30125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.358057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T16:32:48.357 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-11-08T16:32:48.358 INFO:tasks.ceph:Creating RBD pool 2023-11-08T16:32:48.358 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-08T16:32:49.295 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'rbd' created 2023-11-08T16:32:49.306 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-08T16:32:50.311 INFO:teuthology.orchestra.run.smithi196.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-08T16:32:50.324 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-08T16:32:50.325 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-08T16:32:50.326 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-08T16:32:50.326 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-08T16:32:50.327 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-08T16:32:50.644 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:50.657 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":4,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":29938},{"type":"v1","addr":"172.21.15.196:6825","nonce":29938}]},"active_addr":"172.21.15.196:6825/29938","active_change":"2023-11-08T16:32:46.283205+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1044629835}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":531993772}]}]} 2023-11-08T16:32:50.662 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-08T16:32:50.663 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-08T16:32:50.663 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T16:32:50.942 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:50.943 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":10,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T16:32:50.283567+0000","last_up_change":"2023-11-08T16:32:48.264488+0000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-08T16:32:48.330442+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T16:32:48.682940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":30123},{"type":"v1","addr":"172.21.15.196:6801","nonce":30123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":30123},{"type":"v1","addr":"172.21.15.196:6803","nonce":30123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":30123},{"type":"v1","addr":"172.21.15.196:6807","nonce":30123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":30123},{"type":"v1","addr":"172.21.15.196:6805","nonce":30123}]},"public_addr":"172.21.15.196:6801/30123","cluster_addr":"172.21.15.196:6803/30123","heartbeat_back_addr":"172.21.15.196:6807/30123","heartbeat_front_addr":"172.21.15.196:6805/30123","state":["exists","up"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":30124},{"type":"v1","addr":"172.21.15.196:6817","nonce":30124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":30124},{"type":"v1","addr":"172.21.15.196:6819","nonce":30124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":30124},{"type":"v1","addr":"172.21.15.196:6823","nonce":30124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":30124},{"type":"v1","addr":"172.21.15.196:6821","nonce":30124}]},"public_addr":"172.21.15.196:6817/30124","cluster_addr":"172.21.15.196:6819/30124","heartbeat_back_addr":"172.21.15.196:6823/30124","heartbeat_front_addr":"172.21.15.196:6821/30124","state":["exists","up"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":30125},{"type":"v1","addr":"172.21.15.196:6809","nonce":30125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":30125},{"type":"v1","addr":"172.21.15.196:6811","nonce":30125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":30125},{"type":"v1","addr":"172.21.15.196:6815","nonce":30125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":30125},{"type":"v1","addr":"172.21.15.196:6813","nonce":30125}]},"public_addr":"172.21.15.196:6809/30125","cluster_addr":"172.21.15.196:6811/30125","heartbeat_back_addr":"172.21.15.196:6815/30125","heartbeat_front_addr":"172.21.15.196:6813/30125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.305629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.358057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.524266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T16:32:50.956 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-08T16:32:50.956 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T16:32:51.236 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:51.236 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":10,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T16:32:50.283567+0000","last_up_change":"2023-11-08T16:32:48.264488+0000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-08T16:32:48.330442+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T16:32:48.682940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":30123},{"type":"v1","addr":"172.21.15.196:6801","nonce":30123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":30123},{"type":"v1","addr":"172.21.15.196:6803","nonce":30123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":30123},{"type":"v1","addr":"172.21.15.196:6807","nonce":30123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":30123},{"type":"v1","addr":"172.21.15.196:6805","nonce":30123}]},"public_addr":"172.21.15.196:6801/30123","cluster_addr":"172.21.15.196:6803/30123","heartbeat_back_addr":"172.21.15.196:6807/30123","heartbeat_front_addr":"172.21.15.196:6805/30123","state":["exists","up"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":30124},{"type":"v1","addr":"172.21.15.196:6817","nonce":30124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":30124},{"type":"v1","addr":"172.21.15.196:6819","nonce":30124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":30124},{"type":"v1","addr":"172.21.15.196:6823","nonce":30124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":30124},{"type":"v1","addr":"172.21.15.196:6821","nonce":30124}]},"public_addr":"172.21.15.196:6817/30124","cluster_addr":"172.21.15.196:6819/30124","heartbeat_back_addr":"172.21.15.196:6823/30124","heartbeat_front_addr":"172.21.15.196:6821/30124","state":["exists","up"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":30125},{"type":"v1","addr":"172.21.15.196:6809","nonce":30125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":30125},{"type":"v1","addr":"172.21.15.196:6811","nonce":30125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":30125},{"type":"v1","addr":"172.21.15.196:6815","nonce":30125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":30125},{"type":"v1","addr":"172.21.15.196:6813","nonce":30125}]},"public_addr":"172.21.15.196:6809/30125","cluster_addr":"172.21.15.196:6811/30125","heartbeat_back_addr":"172.21.15.196:6815/30125","heartbeat_front_addr":"172.21.15.196:6813/30125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.305629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.358057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.524266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T16:32:51.250 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-08T16:32:51.407 INFO:teuthology.orchestra.run.smithi196.stdout:34359738370 2023-11-08T16:32:51.408 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-08T16:32:51.558 INFO:teuthology.orchestra.run.smithi196.stdout:30064771074 2023-11-08T16:32:51.558 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-08T16:32:51.710 INFO:teuthology.orchestra.run.smithi196.stdout:34359738371 2023-11-08T16:32:51.711 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T16:32:51.990 INFO:teuthology.orchestra.run.smithi196.stdout:34359738369 2023-11-08T16:32:52.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738369 for osd.0 2023-11-08T16:32:53.004 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-08T16:32:53.295 INFO:teuthology.orchestra.run.smithi196.stdout:34359738370 2023-11-08T16:32:53.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.0 2023-11-08T16:32:53.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-08T16:32:53.582 INFO:teuthology.orchestra.run.smithi196.stdout:30064771074 2023-11-08T16:32:53.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 30064771074 got 30064771074 for osd.1 2023-11-08T16:32:53.596 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-08T16:32:53.868 INFO:teuthology.orchestra.run.smithi196.stdout:34359738371 2023-11-08T16:32:53.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2023-11-08T16:32:53.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T16:32:53.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T16:32:54.152 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:54.155 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T16:32:54.165 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-11-08T16:32:52.293641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223964,"statfs":{"total":289910292480,"available":288997339136,"internally_reserved":0,"allocated":274432,"data_stored":72370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.314177+0000","last_change":"2023-11-08T16:32:50.314177+0000","last_active":"2023-11-08T16:32:50.314177+0000","last_peered":"2023-11-08T16:32:50.314177+0000","last_clean":"2023-11-08T16:32:50.314177+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T16:32:50.314177+0000","last_undegraded":"2023-11-08T16:32:50.314177+0000","last_fullsized":"2023-11-08T16:32:50.314177+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311732+0000","last_change":"2023-11-08T16:32:50.311732+0000","last_active":"2023-11-08T16:32:50.311732+0000","last_peered":"2023-11-08T16:32:50.311732+0000","last_clean":"2023-11-08T16:32:50.311732+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T16:32:50.311732+0000","last_undegraded":"2023-11-08T16:32:50.311732+0000","last_fullsized":"2023-11-08T16:32:50.311732+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.312351+0000","last_change":"2023-11-08T16:32:50.312351+0000","last_active":"2023-11-08T16:32:50.312351+0000","last_peered":"2023-11-08T16:32:50.312351+0000","last_clean":"2023-11-08T16:32:50.312351+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T16:32:50.312351+0000","last_undegraded":"2023-11-08T16:32:50.312351+0000","last_fullsized":"2023-11-08T16:32:50.312351+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311809+0000","last_change":"2023-11-08T16:32:50.311809+0000","last_active":"2023-11-08T16:32:50.311809+0000","last_peered":"2023-11-08T16:32:50.311809+0000","last_clean":"2023-11-08T16:32:50.311809+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T16:32:50.311809+0000","last_undegraded":"2023-11-08T16:32:50.311809+0000","last_fullsized":"2023-11-08T16:32:50.311809+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311296+0000","last_change":"2023-11-08T16:32:50.311296+0000","last_active":"2023-11-08T16:32:50.311296+0000","last_peered":"2023-11-08T16:32:50.311296+0000","last_clean":"2023-11-08T16:32:50.311296+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T16:32:50.311296+0000","last_undegraded":"2023-11-08T16:32:50.311296+0000","last_fullsized":"2023-11-08T16:32:50.311296+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311061+0000","last_change":"2023-11-08T16:32:50.309527+0000","last_active":"2023-11-08T16:32:50.311061+0000","last_peered":"2023-11-08T16:32:50.311061+0000","last_clean":"2023-11-08T16:32:50.311061+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T16:32:50.311061+0000","last_undegraded":"2023-11-08T16:32:50.311061+0000","last_fullsized":"2023-11-08T16:32:50.311061+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315669+0000","last_change":"2023-11-08T16:32:50.312760+0000","last_active":"2023-11-08T16:32:50.315669+0000","last_peered":"2023-11-08T16:32:50.315669+0000","last_clean":"2023-11-08T16:32:50.315669+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T16:32:50.315669+0000","last_undegraded":"2023-11-08T16:32:50.315669+0000","last_fullsized":"2023-11-08T16:32:50.315669+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.308947+0000","last_change":"2023-11-08T16:32:50.308947+0000","last_active":"2023-11-08T16:32:50.308947+0000","last_peered":"2023-11-08T16:32:50.308947+0000","last_clean":"2023-11-08T16:32:50.308947+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T16:32:50.308947+0000","last_undegraded":"2023-11-08T16:32:50.308947+0000","last_fullsized":"2023-11-08T16:32:50.308947+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.310519+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T16:32:50.310519+0000","last_peered":"2023-11-08T16:32:50.310519+0000","last_clean":"2023-11-08T16:32:50.310519+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T16:32:50.310519+0000","last_undegraded":"2023-11-08T16:32:50.310519+0000","last_fullsized":"2023-11-08T16:32:50.310519+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":27088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738370,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297180,"kb_used_data":84,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074660,"statfs":{"total":96636764160,"available":96332451840,"internally_reserved":0,"allocated":86016,"data_stored":22106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":1,"up_from":7,"seq":30064771074,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":23176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.158}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.193}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T16:32:54.166 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T16:32:54.443 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T16:32:54.456 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-11-08T16:32:54.294171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891564,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223956,"statfs":{"total":289910292480,"available":288997330944,"internally_reserved":0,"allocated":282624,"data_stored":76282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.321020+0000","last_change":"2023-11-08T16:32:50.314177+0000","last_active":"2023-11-08T16:32:50.321020+0000","last_peered":"2023-11-08T16:32:50.321020+0000","last_clean":"2023-11-08T16:32:50.321020+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T16:32:50.321020+0000","last_undegraded":"2023-11-08T16:32:50.321020+0000","last_fullsized":"2023-11-08T16:32:50.321020+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315621+0000","last_change":"2023-11-08T16:32:50.311732+0000","last_active":"2023-11-08T16:32:50.315621+0000","last_peered":"2023-11-08T16:32:50.315621+0000","last_clean":"2023-11-08T16:32:50.315621+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T16:32:50.315621+0000","last_undegraded":"2023-11-08T16:32:50.315621+0000","last_fullsized":"2023-11-08T16:32:50.315621+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315730+0000","last_change":"2023-11-08T16:32:50.312351+0000","last_active":"2023-11-08T16:32:50.315730+0000","last_peered":"2023-11-08T16:32:50.315730+0000","last_clean":"2023-11-08T16:32:50.315730+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T16:32:50.315730+0000","last_undegraded":"2023-11-08T16:32:50.315730+0000","last_fullsized":"2023-11-08T16:32:50.315730+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315642+0000","last_change":"2023-11-08T16:32:50.311809+0000","last_active":"2023-11-08T16:32:50.315642+0000","last_peered":"2023-11-08T16:32:50.315642+0000","last_clean":"2023-11-08T16:32:50.315642+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T16:32:50.315642+0000","last_undegraded":"2023-11-08T16:32:50.315642+0000","last_fullsized":"2023-11-08T16:32:50.315642+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315438+0000","last_change":"2023-11-08T16:32:50.311296+0000","last_active":"2023-11-08T16:32:50.315438+0000","last_peered":"2023-11-08T16:32:50.315438+0000","last_clean":"2023-11-08T16:32:50.315438+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T16:32:50.315438+0000","last_undegraded":"2023-11-08T16:32:50.315438+0000","last_fullsized":"2023-11-08T16:32:50.315438+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311061+0000","last_change":"2023-11-08T16:32:50.309527+0000","last_active":"2023-11-08T16:32:50.311061+0000","last_peered":"2023-11-08T16:32:50.311061+0000","last_clean":"2023-11-08T16:32:50.311061+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T16:32:50.311061+0000","last_undegraded":"2023-11-08T16:32:50.311061+0000","last_fullsized":"2023-11-08T16:32:50.311061+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.315669+0000","last_change":"2023-11-08T16:32:50.312760+0000","last_active":"2023-11-08T16:32:50.315669+0000","last_peered":"2023-11-08T16:32:50.315669+0000","last_clean":"2023-11-08T16:32:50.315669+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T16:32:50.315669+0000","last_undegraded":"2023-11-08T16:32:50.315669+0000","last_fullsized":"2023-11-08T16:32:50.315669+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.311281+0000","last_change":"2023-11-08T16:32:50.308947+0000","last_active":"2023-11-08T16:32:50.311281+0000","last_peered":"2023-11-08T16:32:50.311281+0000","last_clean":"2023-11-08T16:32:50.311281+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T16:32:50.311281+0000","last_undegraded":"2023-11-08T16:32:50.311281+0000","last_fullsized":"2023-11-08T16:32:50.311281+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-11-08T16:32:50.312561+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T16:32:50.312561+0000","last_peered":"2023-11-08T16:32:50.312561+0000","last_clean":"2023-11-08T16:32:50.312561+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T16:32:50.312561+0000","last_undegraded":"2023-11-08T16:32:50.312561+0000","last_fullsized":"2023-11-08T16:32:50.312561+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":27088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":26018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":1,"up_from":7,"seq":30064771075,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297184,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074656,"statfs":{"total":96636764160,"available":96332447744,"internally_reserved":0,"allocated":90112,"data_stored":23176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T16:32:54.457 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T16:32:54.458 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-08T16:32:54.458 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-08T16:32:54.458 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-08T16:32:54.760 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T16:32:54.773 INFO:teuthology.orchestra.run.smithi196.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-08T16:32:54.774 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-08T16:32:54.774 INFO:teuthology.run_tasks:Running task exec... 2023-11-08T16:32:54.785 INFO:teuthology.task.exec:Executing custom commands... 2023-11-08T16:32:54.785 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T16:32:54.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-11-08T16:32:55.338 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cache' created 2023-11-08T16:32:55.351 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-11-08T16:32:56.339 INFO:teuthology.orchestra.run.smithi196.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-11-08T16:32:56.353 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-11-08T16:32:57.361 INFO:teuthology.orchestra.run.smithi196.stderr:set cache-mode for pool 'cache' to writeback 2023-11-08T16:32:57.376 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-11-08T16:32:58.365 INFO:teuthology.orchestra.run.smithi196.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-11-08T16:32:58.379 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-11-08T16:32:59.374 INFO:teuthology.orchestra.run.smithi196.stderr:set pool 3 hit_set_type to bloom 2023-11-08T16:32:59.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-11-08T16:33:00.375 INFO:teuthology.orchestra.run.smithi196.stderr:set pool 3 hit_set_count to 8 2023-11-08T16:33:00.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-11-08T16:33:01.377 INFO:teuthology.orchestra.run.smithi196.stderr:set pool 3 hit_set_period to 60 2023-11-08T16:33:01.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-11-08T16:33:02.385 INFO:teuthology.orchestra.run.smithi196.stderr:set pool 3 target_max_objects to 250 2023-11-08T16:33:02.399 INFO:teuthology.run_tasks:Running task workunit... 2023-11-08T16:33:02.412 INFO:tasks.workunit:Pulling workunits from ref cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f 2023-11-08T16:33:02.412 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-11-08T16:33:02.413 DEBUG:teuthology.orchestra.run.smithi196:> stat -- /home/ubuntu/cephtest/mnt.0 2023-11-08T16:33:02.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T16:33:02.421 INFO:teuthology.orchestra.run.smithi196.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-08T16:33:02.421 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-11-08T16:33:02.427 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-11-08T16:33:02.427 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-11-08T16:33:02.477 INFO:tasks.workunit:timeout=3h 2023-11-08T16:33:02.477 INFO:tasks.workunit:cleanup=True 2023-11-08T16:33:02.478 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f 2023-11-08T16:33:02.487 INFO:tasks.workunit.client.0.smithi196.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-11-08T16:33:49.941 INFO:tasks.workunit.client.0.smithi196.stderr:Note: switching to 'cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f'. 2023-11-08T16:33:49.942 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.942 INFO:tasks.workunit.client.0.smithi196.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-11-08T16:33:49.942 INFO:tasks.workunit.client.0.smithi196.stderr:changes and commit them, and you can discard any commits you make in this 2023-11-08T16:33:49.942 INFO:tasks.workunit.client.0.smithi196.stderr:state without impacting any branches by switching back to a branch. 2023-11-08T16:33:49.943 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.943 INFO:tasks.workunit.client.0.smithi196.stderr:If you want to create a new branch to retain commits you create, you may 2023-11-08T16:33:49.943 INFO:tasks.workunit.client.0.smithi196.stderr:do so (now or later) by using -c with the switch command. Example: 2023-11-08T16:33:49.943 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.943 INFO:tasks.workunit.client.0.smithi196.stderr: git switch -c 2023-11-08T16:33:49.944 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.944 INFO:tasks.workunit.client.0.smithi196.stderr:Or undo this operation with: 2023-11-08T16:33:49.944 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.944 INFO:tasks.workunit.client.0.smithi196.stderr: git switch - 2023-11-08T16:33:49.944 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.945 INFO:tasks.workunit.client.0.smithi196.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-11-08T16:33:49.945 INFO:tasks.workunit.client.0.smithi196.stderr: 2023-11-08T16:33:49.945 INFO:tasks.workunit.client.0.smithi196.stderr:HEAD is now at cfb6fd52113 Merge branch 'wip-63385-pacific' of https://github.com/ajarr/ceph into wip-yuri3-testing-2023-11-07-0801-pacific 2023-11-08T16:33:49.947 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-11-08T16:33:49.967 INFO:tasks.workunit.client.0.smithi196.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-11-08T16:33:49.971 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-08T16:33:49.971 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-11-08T16:33:50.880 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-11-08T16:33:50.986 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-11-08T16:33:51.051 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-11-08T16:33:51.053 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-08T16:33:51.053 INFO:tasks.workunit.client.0.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-11-08T16:33:51.117 INFO:tasks.workunit.client.0.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-11-08T16:33:51.122 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2023-11-08T16:33:51.123 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-11-08T16:33:51.174 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-11-08T16:33:51.175 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-11-08T16:33:51.175 DEBUG:teuthology.orchestra.run.smithi196:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-11-08T16:33:51.191 INFO:tasks.workunit.client.0.smithi196.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-11-08T16:33:51.193 INFO:tasks.workunit.client.0.smithi196.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-11-08T16:33:51.193 INFO:tasks.workunit.client.0.smithi196.stderr:++ TIMEOUT=300 2023-11-08T16:33:51.193 INFO:tasks.workunit.client.0.smithi196.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-11-08T16:33:51.194 INFO:tasks.workunit.client.0.smithi196.stderr:++ MAX_TIMEOUT=15 2023-11-08T16:33:51.194 INFO:tasks.workunit.client.0.smithi196.stderr:++ PG_NUM=4 2023-11-08T16:33:51.194 INFO:tasks.workunit.client.0.smithi196.stderr:++ TMPDIR=/tmp 2023-11-08T16:33:51.194 INFO:tasks.workunit.client.0.smithi196.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-11-08T16:33:51.194 INFO:tasks.workunit.client.0.smithi196.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-11-08T16:33:51.195 INFO:tasks.workunit.client.0.smithi196.stderr:++ type xmlstarlet 2023-11-08T16:33:51.195 INFO:tasks.workunit.client.0.smithi196.stderr:++ XMLSTARLET=xmlstarlet 2023-11-08T16:33:51.196 INFO:tasks.workunit.client.0.smithi196.stderr:+++ uname 2023-11-08T16:33:51.196 INFO:tasks.workunit.client.0.smithi196.stderr:++ '[' Linux = FreeBSD ']' 2023-11-08T16:33:51.196 INFO:tasks.workunit.client.0.smithi196.stderr:++ SED=sed 2023-11-08T16:33:51.196 INFO:tasks.workunit.client.0.smithi196.stderr:++ AWK=awk 2023-11-08T16:33:51.197 INFO:tasks.workunit.client.0.smithi196.stderr:+++ stty -a 2023-11-08T16:33:51.197 INFO:tasks.workunit.client.0.smithi196.stderr:+++ head -1 2023-11-08T16:33:51.197 INFO:tasks.workunit.client.0.smithi196.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-11-08T16:33:51.201 INFO:tasks.workunit.client.0.smithi196.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-11-08T16:33:51.202 INFO:tasks.workunit.client.0.smithi196.stderr:++ termwidth= 2023-11-08T16:33:51.203 INFO:tasks.workunit.client.0.smithi196.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-11-08T16:33:51.203 INFO:tasks.workunit.client.0.smithi196.stderr:++ DIFFCOLOPTS='-y ' 2023-11-08T16:33:51.203 INFO:tasks.workunit.client.0.smithi196.stderr:++ KERNCORE=kernel.core_pattern 2023-11-08T16:33:51.203 INFO:tasks.workunit.client.0.smithi196.stderr:++ EXTRA_OPTS= 2023-11-08T16:33:51.212 INFO:tasks.workunit.client.0.smithi196.stderr:++ test '' = TESTS 2023-11-08T16:33:51.213 INFO:tasks.workunit.client.0.smithi196.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-11-08T16:33:51.213 INFO:tasks.workunit.client.0.smithi196.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-11-08T16:33:51.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:33:51.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:33:51.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v '^0$' 2023-11-08T16:33:51.263 INFO:tasks.workunit.client.0.smithi196.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-11-08T16:33:51.263 INFO:tasks.workunit.client.0.smithi196.stderr:+ tiered=0 2023-11-08T16:33:51.263 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd dump 2023-11-08T16:33:51.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^pool' 2023-11-08T16:33:51.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ''\''rbd'\''' 2023-11-08T16:33:51.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep tier 2023-11-08T16:33:51.633 INFO:tasks.workunit.client.0.smithi196.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 lfor 15/15/15 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-11-08T16:33:51.634 INFO:tasks.workunit.client.0.smithi196.stderr:+ tiered=1 2023-11-08T16:33:51.640 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_pool_image_args 2023-11-08T16:33:51.640 INFO:tasks.workunit.client.0.smithi196.stdout:testing pool and image args... 2023-11-08T16:33:51.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing pool and image args...' 2023-11-08T16:33:51.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:33:51.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:51.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:51.868 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:51.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.094 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.205 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.323 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.435 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.547 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.661 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.776 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:52.889 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.006 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.124 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.341 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.464 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.581 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:33:53.691 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-11-08T16:33:54.059 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'test' does not exist 2023-11-08T16:33:54.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool create test 32 2023-11-08T16:33:55.404 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'test' already exists 2023-11-08T16:33:55.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd pool init test 2023-11-08T16:33:58.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-11-08T16:33:58.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:33:58.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:33:58.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:33:58.379 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:33:58.379 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 1 test1 2023-11-08T16:33:58.418 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:33:58.411+0000 7f7edc004340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:00.349 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:00.350 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test1 2023-11-08T16:34:00.382 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import --image test2 /tmp/empty 2023-11-08T16:34:00.419 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:00.415+0000 7fc110d52340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:00.438 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:00.439 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:00.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:00.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test2 2023-11-08T16:34:00.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --dest test3 import /tmp/empty 2023-11-08T16:34:00.523 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:00.515+0000 7f96d1f83340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:00.540 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:00.546 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:00.546 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test3 2023-11-08T16:34:00.586 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import /tmp/empty foo 2023-11-08T16:34:00.622 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:00.615+0000 7f9d94170340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:00.641 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:00.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:00.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q foo 2023-11-08T16:34:00.687 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-11-08T16:34:00.714 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-11-08T16:34:00.716 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:34:00.716 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import /tmp/empty test/empty@snap 2023-11-08T16:34:00.741 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-11-08T16:34:00.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:34:00.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-11-08T16:34:00.763 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-11-08T16:34:00.764 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:00.765 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:34:00.765 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import /tmp/empty@snap 2023-11-08T16:34:00.792 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-11-08T16:34:00.793 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:34:00.793 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:00.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:00.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:34:00.832 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:34:00.833 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import /tmp/empty test/test1 2023-11-08T16:34:00.870 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:00.863+0000 7f0494bf7340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.384 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test1 2023-11-08T16:34:02.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p test import /tmp/empty test2 2023-11-08T16:34:02.466 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:02.459+0000 7f76bdc23340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.489 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.490 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-11-08T16:34:02.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test2 2023-11-08T16:34:02.532 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-11-08T16:34:02.572 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:02.567+0000 7f70fc29d340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.591 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.592 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:02.592 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-11-08T16:34:02.596 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.596 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test3 2023-11-08T16:34:02.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-11-08T16:34:02.682 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:02.675+0000 7fab955ff340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.702 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.704 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:02.704 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-11-08T16:34:02.708 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.708 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test4 2023-11-08T16:34:02.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-11-08T16:34:02.791 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:02.783+0000 7fd7d1bbe340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.808 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.809 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-11-08T16:34:02.814 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test5 2023-11-08T16:34:02.814 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.855 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-11-08T16:34:02.894 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:02.887+0000 7fe2ae199340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:02.916 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:02.921 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:02.921 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test6 2023-11-08T16:34:02.965 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-11-08T16:34:03.008 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:03.003+0000 7fa18d775340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:03.030 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:03.031 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:03.034 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:03.035 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test7 2023-11-08T16:34:03.075 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --image test/test8 import /tmp/empty 2023-11-08T16:34:03.112 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:03.107+0000 7f33543de340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:03.131 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:03.132 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: --image is deprecated, use --dest 2023-11-08T16:34:03.136 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:03.136 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test8 2023-11-08T16:34:03.181 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-11-08T16:34:03.221 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:03.215+0000 7f5ca855f340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:03.241 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:03.246 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:03.246 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test9 2023-11-08T16:34:03.292 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import --pool test /tmp/empty 2023-11-08T16:34:03.334 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:03.327+0000 7f2d0f222340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:03.353 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:34:03.354 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-11-08T16:34:03.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:03.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q empty 2023-11-08T16:34:03.400 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy test/test9 test10 2023-11-08T16:34:05.324 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:34:05.330 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:05.330 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -qv test10 2023-11-08T16:34:05.374 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:05.374 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test10 2023-11-08T16:34:05.414 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy test/test9 test/test10 2023-11-08T16:34:05.495 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:34:05.502 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:05.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test10 2023-11-08T16:34:05.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-11-08T16:34:05.631 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:34:05.638 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:05.638 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -q test11 2023-11-08T16:34:05.679 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-11-08T16:34:05.770 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:34:05.776 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:05.777 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test12 2023-11-08T16:34:05.819 INFO:tasks.workunit.client.0.smithi196.stdout:test12 2023-11-08T16:34:05.819 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls test 2023-11-08T16:34:05.820 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -qv test12 2023-11-08T16:34:05.864 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-11-08T16:34:05.865 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-11-08T16:34:06.475 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'test' does not exist 2023-11-08T16:34:06.484 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.484 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm foo 2023-11-08T16:34:06.534 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:06.538 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.538 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:34:06.595 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:06.598 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.599 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test10 2023-11-08T16:34:06.727 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:06.732 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.733 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test12 2023-11-08T16:34:06.866 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:06.871 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.871 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:34:06.934 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:06.938 INFO:tasks.workunit.client.0.smithi196.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-11-08T16:34:06.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test3 2023-11-08T16:34:06.998 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:07.002 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_rename 2023-11-08T16:34:07.003 INFO:tasks.workunit.client.0.smithi196.stdout:testing rename... 2023-11-08T16:34:07.003 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing rename...' 2023-11-08T16:34:07.004 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:34:07.004 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.109 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.228 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.340 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.572 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:07.685 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.000 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.116 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.233 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.346 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.456 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.685 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.800 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:08.909 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:09.024 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:09.141 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:09.251 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 foo 2023-11-08T16:34:09.281 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:34:09.292 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:09.287+0000 7fc0b05af340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:09.302 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 bar 2023-11-08T16:34:09.362 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename foo foo2 2023-11-08T16:34:09.431 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename foo2 bar 2023-11-08T16:34:09.431 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep exists 2023-11-08T16:34:09.487 INFO:tasks.workunit.client.0.smithi196.stdout:2023-11-08T16:34:09.471+0000 7fa8410cf340 -1 librbd::Operations: rbd image bar already exists 2023-11-08T16:34:09.487 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: rename error: (17) File exists 2023-11-08T16:34:09.488 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename bar bar2 2023-11-08T16:34:09.572 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename bar2 foo2 2023-11-08T16:34:09.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep exists 2023-11-08T16:34:09.635 INFO:tasks.workunit.client.0.smithi196.stdout:2023-11-08T16:34:09.623+0000 7ffbd0a19340 -1 librbd::Operations: rbd image foo2 already exists 2023-11-08T16:34:09.636 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: rename error: (17) File exists 2023-11-08T16:34:09.636 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool create rbd2 8 2023-11-08T16:34:10.139 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' already exists 2023-11-08T16:34:10.147 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd pool init rbd2 2023-11-08T16:34:12.311 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -p rbd2 -s 1 foo 2023-11-08T16:34:12.348 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:12.343+0000 7fc20c982340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:14.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-11-08T16:34:14.395 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls 2023-11-08T16:34:14.396 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep bar 2023-11-08T16:34:14.441 INFO:tasks.workunit.client.0.smithi196.stdout:bar 2023-11-08T16:34:14.441 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename rbd2/bar foo 2023-11-08T16:34:14.510 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename --pool rbd2 foo bar 2023-11-08T16:34:14.585 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-11-08T16:34:14.614 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: mv/rename across pools not supported 2023-11-08T16:34:14.614 INFO:tasks.workunit.client.0.smithi196.stderr:source pool: rbd2 dest pool: rbd 2023-11-08T16:34:14.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-11-08T16:34:14.687 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls 2023-11-08T16:34:14.688 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep foo 2023-11-08T16:34:14.729 INFO:tasks.workunit.client.0.smithi196.stdout:foo 2023-11-08T16:34:14.729 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-11-08T16:34:15.426 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' does not exist 2023-11-08T16:34:15.434 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:34:15.434 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:15.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:15.667 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:15.783 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:15.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.011 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.448 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.560 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.677 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.786 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:16.902 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.014 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.244 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.464 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.576 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:17.897 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.010 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_ls 2023-11-08T16:34:18.011 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing ls...' 2023-11-08T16:34:18.011 INFO:tasks.workunit.client.0.smithi196.stdout:testing ls... 2023-11-08T16:34:18.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:34:18.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.122 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.242 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.350 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.459 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.576 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.692 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.807 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:18.917 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.145 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.261 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.377 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.496 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.610 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.724 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.834 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:19.947 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:20.052 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 test1 2023-11-08T16:34:20.081 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:34:20.095 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:20.091+0000 7f7dc0aa6340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:20.107 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 test2 2023-11-08T16:34:20.134 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:34:20.148 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:20.143+0000 7f3a26505340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:20.158 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.158 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:34:20.198 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:34:20.199 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.199 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:34:20.236 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:34:20.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:20.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:34:20.277 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:34:20.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:20.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*1 MiB.*1' 2023-11-08T16:34:20.326 INFO:tasks.workunit.client.0.smithi196.stdout:test1 1 MiB 1 2023-11-08T16:34:20.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:20.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*1 MiB.*1' 2023-11-08T16:34:20.378 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 1 2023-11-08T16:34:20.379 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:34:20.440 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:20.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:34:20.507 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:20.511 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:34:20.578 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test2 2023-11-08T16:34:20.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:34:20.680 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:34:20.680 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.680 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:34:20.721 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:34:20.722 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:20.722 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:20.723 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:34:20.761 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:34:20.762 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:20.763 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*1 MiB.*2' 2023-11-08T16:34:20.814 INFO:tasks.workunit.client.0.smithi196.stdout:test1 1 MiB 2 2023-11-08T16:34:20.815 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:20.815 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*1 MiB.*2' 2023-11-08T16:34:20.874 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 2 2023-11-08T16:34:20.875 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:34:21.037 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:21.042 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:34:21.216 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:21.221 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:34:21.289 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 test2 2023-11-08T16:34:21.314 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:34:21.324 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:21.319+0000 7f2885c12340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:21.335 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:21.335 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:34:21.375 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:34:21.376 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:21.376 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:34:21.419 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:34:21.420 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:21.420 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:21.421 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:34:21.461 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:34:21.461 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:21.462 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*1 MiB.*2' 2023-11-08T16:34:21.520 INFO:tasks.workunit.client.0.smithi196.stdout:test1 1 MiB 2 2023-11-08T16:34:21.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:21.521 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*1 MiB.*1' 2023-11-08T16:34:21.576 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 1 2023-11-08T16:34:21.577 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:34:21.577 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:21.689 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:21.802 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:21.914 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.027 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.139 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.245 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.591 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.706 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.812 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:22.918 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.034 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.618 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:34:23.738 INFO:tasks.workunit.client.0.smithi196.stderr:++ seq -w 00 99 2023-11-08T16:34:23.753 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:23.753 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.00 -s 1 2023-11-08T16:34:23.797 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:23.791+0000 7f0116b84340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:23.810 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:23.811 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.01 -s 1 2023-11-08T16:34:23.848 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:23.843+0000 7f5ef4bcb340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:23.857 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:23.858 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.02 -s 1 2023-11-08T16:34:23.894 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:23.887+0000 7fe9c193c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:23.904 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:23.905 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.03 -s 1 2023-11-08T16:34:23.943 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:23.939+0000 7fd4c3d83340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:23.952 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:23.953 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.04 -s 1 2023-11-08T16:34:23.994 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:23.987+0000 7f7f26665340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.003 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.004 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.05 -s 1 2023-11-08T16:34:24.043 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.039+0000 7f9d24042340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.053 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.053 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.06 -s 1 2023-11-08T16:34:24.091 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.087+0000 7f5b909b1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.099 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.099 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.07 -s 1 2023-11-08T16:34:24.138 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.135+0000 7f679b7c3340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.150 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.150 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.08 -s 1 2023-11-08T16:34:24.191 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.187+0000 7f0ef26a4340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.201 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.202 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.09 -s 1 2023-11-08T16:34:24.239 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.235+0000 7f5098f2d340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.250 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.250 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.10 -s 1 2023-11-08T16:34:24.288 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.283+0000 7f00dbd9e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.298 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.298 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.11 -s 1 2023-11-08T16:34:24.340 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.335+0000 7f8d368ca340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.12 -s 1 2023-11-08T16:34:24.390 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.383+0000 7fa59f767340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.401 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.401 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.13 -s 1 2023-11-08T16:34:24.437 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.431+0000 7f6e3d7b9340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.446 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.14 -s 1 2023-11-08T16:34:24.481 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.475+0000 7f139b329340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.491 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.491 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.15 -s 1 2023-11-08T16:34:24.528 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.523+0000 7fabde39e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.541 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.541 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.16 -s 1 2023-11-08T16:34:24.581 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.575+0000 7fa933edf340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.593 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.594 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.17 -s 1 2023-11-08T16:34:24.633 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.627+0000 7f00ad5ca340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.645 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.18 -s 1 2023-11-08T16:34:24.684 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.679+0000 7fe4c5ee1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.19 -s 1 2023-11-08T16:34:24.734 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.727+0000 7faec61bd340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.742 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.20 -s 1 2023-11-08T16:34:24.781 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.775+0000 7fb856a7e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.791 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.21 -s 1 2023-11-08T16:34:24.829 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.823+0000 7fe949661340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.838 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.838 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.22 -s 1 2023-11-08T16:34:24.877 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.871+0000 7f9814df1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.890 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.891 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.23 -s 1 2023-11-08T16:34:24.930 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.923+0000 7f748337a340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.24 -s 1 2023-11-08T16:34:24.987 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:24.983+0000 7f6b16ebe340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:24.997 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:24.997 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.25 -s 1 2023-11-08T16:34:25.036 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.031+0000 7f52f6e3a340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.046 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.047 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.26 -s 1 2023-11-08T16:34:25.083 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.079+0000 7f83fbcff340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.093 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.094 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.27 -s 1 2023-11-08T16:34:25.130 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.127+0000 7ff526866340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.140 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.140 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.28 -s 1 2023-11-08T16:34:25.177 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.171+0000 7f54bb872340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.29 -s 1 2023-11-08T16:34:25.226 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.219+0000 7fc3f7c7e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.235 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.30 -s 1 2023-11-08T16:34:25.273 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.267+0000 7fc8da893340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.285 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.286 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.31 -s 1 2023-11-08T16:34:25.322 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.315+0000 7ff3b51fa340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.32 -s 1 2023-11-08T16:34:25.369 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.363+0000 7f5244788340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.378 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.378 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.33 -s 1 2023-11-08T16:34:25.417 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.411+0000 7fc7bc65f340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.34 -s 1 2023-11-08T16:34:25.466 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.459+0000 7f87ff9b8340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.476 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.477 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.35 -s 1 2023-11-08T16:34:25.515 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.511+0000 7f6e451df340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.524 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.524 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.36 -s 1 2023-11-08T16:34:25.560 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.555+0000 7f82ce231340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.37 -s 1 2023-11-08T16:34:25.612 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.607+0000 7f25f68b0340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.624 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.624 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.38 -s 1 2023-11-08T16:34:25.665 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.659+0000 7f5e289fb340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.39 -s 1 2023-11-08T16:34:25.717 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.711+0000 7f9b9f653340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.728 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.728 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.40 -s 1 2023-11-08T16:34:25.765 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.759+0000 7f29c69ec340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.775 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.775 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.41 -s 1 2023-11-08T16:34:25.813 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.807+0000 7fe1013e3340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.822 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.823 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.42 -s 1 2023-11-08T16:34:25.861 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.855+0000 7f16d8732340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.875 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.875 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.43 -s 1 2023-11-08T16:34:25.916 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.911+0000 7f4201159340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.927 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.927 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.44 -s 1 2023-11-08T16:34:25.966 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:25.959+0000 7f5f68c74340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:25.975 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:25.976 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.45 -s 1 2023-11-08T16:34:26.014 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.007+0000 7f4ca9a7c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.025 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.025 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.46 -s 1 2023-11-08T16:34:26.061 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.055+0000 7f717373a340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.073 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.074 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.47 -s 1 2023-11-08T16:34:26.111 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.107+0000 7ff68a4d0340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.120 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.120 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.48 -s 1 2023-11-08T16:34:26.157 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.151+0000 7f15d1c22340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.167 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.49 -s 1 2023-11-08T16:34:26.205 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.199+0000 7f88d9cd2340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.50 -s 1 2023-11-08T16:34:26.253 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.247+0000 7f5a7374b340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.263 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.51 -s 1 2023-11-08T16:34:26.303 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.299+0000 7f5311b2e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.313 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.314 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.52 -s 1 2023-11-08T16:34:26.350 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.347+0000 7f02ec831340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.53 -s 1 2023-11-08T16:34:26.398 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.391+0000 7f0c3982c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.407 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.407 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.54 -s 1 2023-11-08T16:34:26.442 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.439+0000 7fd9f53e6340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.451 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.452 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.55 -s 1 2023-11-08T16:34:26.491 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.487+0000 7f5384059340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.500 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.500 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.56 -s 1 2023-11-08T16:34:26.538 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.535+0000 7f4fafa29340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.57 -s 1 2023-11-08T16:34:26.587 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.583+0000 7f4fdd663340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.602 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.602 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.58 -s 1 2023-11-08T16:34:26.640 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.635+0000 7f9ffea95340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.59 -s 1 2023-11-08T16:34:26.689 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.683+0000 7f379adf0340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.60 -s 1 2023-11-08T16:34:26.741 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.735+0000 7fb847ce1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.756 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.756 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.61 -s 1 2023-11-08T16:34:26.793 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.787+0000 7f21174f7340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.805 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.806 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.62 -s 1 2023-11-08T16:34:26.844 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.839+0000 7f3da25b5340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.63 -s 1 2023-11-08T16:34:26.890 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.883+0000 7fb744540340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.901 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.902 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.64 -s 1 2023-11-08T16:34:26.938 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.931+0000 7f70e5ed1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.948 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.948 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.65 -s 1 2023-11-08T16:34:26.986 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:26.979+0000 7fd6e1ee6340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:26.996 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:26.996 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.66 -s 1 2023-11-08T16:34:27.032 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.027+0000 7f98365c6340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.043 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.044 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.67 -s 1 2023-11-08T16:34:27.077 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.071+0000 7f82a88b2340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.087 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.087 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.68 -s 1 2023-11-08T16:34:27.124 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.119+0000 7f384b242340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.138 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.138 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.69 -s 1 2023-11-08T16:34:27.173 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.167+0000 7fe2fc84b340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.182 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.182 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.70 -s 1 2023-11-08T16:34:27.221 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.215+0000 7f60d85aa340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.71 -s 1 2023-11-08T16:34:27.269 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.263+0000 7fbb89c5f340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.279 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.279 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.72 -s 1 2023-11-08T16:34:27.316 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.311+0000 7f18463fc340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.73 -s 1 2023-11-08T16:34:27.375 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.371+0000 7f5e70ea1340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.74 -s 1 2023-11-08T16:34:27.424 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.419+0000 7f9fd02ad340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.434 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.435 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.75 -s 1 2023-11-08T16:34:27.471 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.467+0000 7fb1595b3340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.76 -s 1 2023-11-08T16:34:27.522 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.519+0000 7faceda12340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.532 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.532 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.77 -s 1 2023-11-08T16:34:27.572 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.567+0000 7f772dc5d340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.589 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.589 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.78 -s 1 2023-11-08T16:34:27.627 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.623+0000 7f0c4356c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.638 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.79 -s 1 2023-11-08T16:34:27.676 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.671+0000 7f623f2b0340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.689 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.689 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.80 -s 1 2023-11-08T16:34:27.731 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.727+0000 7f055b615340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.744 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.745 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.81 -s 1 2023-11-08T16:34:27.782 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.775+0000 7ff865abc340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.82 -s 1 2023-11-08T16:34:27.835 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.831+0000 7f17fea1c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.847 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.847 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.83 -s 1 2023-11-08T16:34:27.881 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.875+0000 7f484f1a5340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.890 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.891 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.84 -s 1 2023-11-08T16:34:27.930 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.923+0000 7fd17bf0f340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.85 -s 1 2023-11-08T16:34:27.980 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:27.975+0000 7f7500c02340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:27.990 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:27.991 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.86 -s 1 2023-11-08T16:34:28.028 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.023+0000 7f5964831340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.040 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.040 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.87 -s 1 2023-11-08T16:34:28.078 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.075+0000 7fdd7e7bf340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.089 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.089 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.88 -s 1 2023-11-08T16:34:28.128 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.123+0000 7fc09a1e2340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.139 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.139 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.89 -s 1 2023-11-08T16:34:28.174 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.167+0000 7f6f9c626340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.190 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.190 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.90 -s 1 2023-11-08T16:34:28.233 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.227+0000 7f3a9c491340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.244 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.244 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.91 -s 1 2023-11-08T16:34:28.278 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.271+0000 7f7020f93340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.292 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.292 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.92 -s 1 2023-11-08T16:34:28.331 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.327+0000 7f905e895340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.345 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.93 -s 1 2023-11-08T16:34:28.383 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.379+0000 7f9c83daf340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.398 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.399 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.94 -s 1 2023-11-08T16:34:28.433 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.427+0000 7fd6857bd340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.95 -s 1 2023-11-08T16:34:28.483 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.479+0000 7f2024d28340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.96 -s 1 2023-11-08T16:34:28.531 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.527+0000 7f5200496340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.97 -s 1 2023-11-08T16:34:28.586 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.579+0000 7f119918e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.98 -s 1 2023-11-08T16:34:28.635 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.631+0000 7fd862625340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:28.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.99 -s 1 2023-11-08T16:34:28.682 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.679+0000 7f2d0804c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:34:28.695 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:28.695 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:28.696 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 100 2023-11-08T16:34:28.736 INFO:tasks.workunit.client.0.smithi196.stdout:100 2023-11-08T16:34:28.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:28.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep image 2023-11-08T16:34:28.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 100 2023-11-08T16:34:28.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:28.830 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.823+0000 7f96e392c700 0 -- 172.21.15.196:0/1858894176 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55af3a2017c0 msgr2=0x55af3a2a6160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:28.842 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:28.835+0000 7f96e392c700 0 -- 172.21.15.196:0/1858894176 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f96c8033c90 msgr2=0x7f96c80360c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:29.049 INFO:tasks.workunit.client.0.smithi196.stdout:100 2023-11-08T16:34:29.050 INFO:tasks.workunit.client.0.smithi196.stderr:++ seq -w 00 99 2023-11-08T16:34:29.050 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.00 2023-11-08T16:34:29.108 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.112 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.112 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.01 2023-11-08T16:34:29.173 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.178 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.178 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.02 2023-11-08T16:34:29.239 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.243 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.243 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.03 2023-11-08T16:34:29.300 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.305 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.305 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.04 2023-11-08T16:34:29.368 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.372 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.373 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.05 2023-11-08T16:34:29.433 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.439 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.06 2023-11-08T16:34:29.498 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.502 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.07 2023-11-08T16:34:29.566 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.571 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.08 2023-11-08T16:34:29.632 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.636 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.636 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.09 2023-11-08T16:34:29.690 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.694 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.695 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.10 2023-11-08T16:34:29.759 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.764 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.764 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.11 2023-11-08T16:34:29.826 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.12 2023-11-08T16:34:29.893 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.897 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.897 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.13 2023-11-08T16:34:29.959 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:29.964 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:29.964 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.14 2023-11-08T16:34:30.024 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.028 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.028 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.15 2023-11-08T16:34:30.091 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.16 2023-11-08T16:34:30.156 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.160 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.160 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.17 2023-11-08T16:34:30.219 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.224 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.224 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.18 2023-11-08T16:34:30.297 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.302 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.302 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.19 2023-11-08T16:34:30.363 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.367 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.367 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.20 2023-11-08T16:34:30.426 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.430 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.430 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.21 2023-11-08T16:34:30.489 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.495 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.22 2023-11-08T16:34:30.556 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.560 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.560 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.23 2023-11-08T16:34:30.612 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.617 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.617 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.24 2023-11-08T16:34:30.685 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.690 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.690 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.25 2023-11-08T16:34:30.752 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.757 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.758 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.26 2023-11-08T16:34:30.817 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.822 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.822 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.27 2023-11-08T16:34:30.882 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.28 2023-11-08T16:34:30.947 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:30.951 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:30.951 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.29 2023-11-08T16:34:31.012 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.017 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.017 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.30 2023-11-08T16:34:31.076 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.081 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.081 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.31 2023-11-08T16:34:31.143 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.32 2023-11-08T16:34:31.210 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.215 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.215 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.33 2023-11-08T16:34:31.276 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.34 2023-11-08T16:34:31.348 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.35 2023-11-08T16:34:31.409 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.414 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.36 2023-11-08T16:34:31.476 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.37 2023-11-08T16:34:31.544 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.38 2023-11-08T16:34:31.610 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.39 2023-11-08T16:34:31.677 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.681 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.682 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.40 2023-11-08T16:34:31.742 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.41 2023-11-08T16:34:31.805 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.809 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.810 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.42 2023-11-08T16:34:31.871 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.875 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.876 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.43 2023-11-08T16:34:31.939 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:31.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:31.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.44 2023-11-08T16:34:32.008 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.45 2023-11-08T16:34:32.076 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.081 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.081 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.46 2023-11-08T16:34:32.157 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.161 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.161 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.47 2023-11-08T16:34:32.221 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.226 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.227 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.48 2023-11-08T16:34:32.287 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.291 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.291 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.49 2023-11-08T16:34:32.350 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.50 2023-11-08T16:34:32.414 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.419 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.51 2023-11-08T16:34:32.481 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.52 2023-11-08T16:34:32.545 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.53 2023-11-08T16:34:32.607 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.54 2023-11-08T16:34:32.673 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.55 2023-11-08T16:34:32.747 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.56 2023-11-08T16:34:32.806 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.810 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.810 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.57 2023-11-08T16:34:32.872 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.876 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.877 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.58 2023-11-08T16:34:32.937 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:32.942 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:32.942 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.59 2023-11-08T16:34:33.003 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.008 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.009 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.60 2023-11-08T16:34:33.067 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.072 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.072 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.61 2023-11-08T16:34:33.134 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.138 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.139 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.62 2023-11-08T16:34:33.200 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.205 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.205 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.63 2023-11-08T16:34:33.265 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.270 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.270 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.64 2023-11-08T16:34:33.332 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.336 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.337 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.65 2023-11-08T16:34:33.395 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.399 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.399 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.66 2023-11-08T16:34:33.465 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.67 2023-11-08T16:34:33.533 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.538 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.538 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.68 2023-11-08T16:34:33.614 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.619 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.619 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.69 2023-11-08T16:34:33.679 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.684 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.684 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.70 2023-11-08T16:34:33.747 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.71 2023-11-08T16:34:33.813 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.819 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.819 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.72 2023-11-08T16:34:33.880 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.73 2023-11-08T16:34:33.946 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:33.950 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:33.950 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.74 2023-11-08T16:34:34.013 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.018 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.75 2023-11-08T16:34:34.075 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.76 2023-11-08T16:34:34.140 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.145 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.145 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.77 2023-11-08T16:34:34.207 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.78 2023-11-08T16:34:34.273 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.79 2023-11-08T16:34:34.342 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.346 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.346 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.80 2023-11-08T16:34:34.408 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.81 2023-11-08T16:34:34.474 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.479 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.479 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.82 2023-11-08T16:34:34.544 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.548 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.83 2023-11-08T16:34:34.609 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.613 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.613 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.84 2023-11-08T16:34:34.672 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.676 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.676 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.85 2023-11-08T16:34:34.745 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.86 2023-11-08T16:34:34.811 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.816 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.816 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.87 2023-11-08T16:34:34.881 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.885 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.885 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.88 2023-11-08T16:34:34.949 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:34.954 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:34.954 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.89 2023-11-08T16:34:35.025 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.029 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.030 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.90 2023-11-08T16:34:35.096 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.100 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.101 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.91 2023-11-08T16:34:35.163 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.92 2023-11-08T16:34:35.230 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.235 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.235 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.93 2023-11-08T16:34:35.298 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.94 2023-11-08T16:34:35.365 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.369 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.369 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.95 2023-11-08T16:34:35.433 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.437 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.437 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.96 2023-11-08T16:34:35.499 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.504 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.504 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.97 2023-11-08T16:34:35.567 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.571 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.572 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.98 2023-11-08T16:34:35.638 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.642 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.643 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.99 2023-11-08T16:34:35.700 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:35.705 INFO:tasks.workunit.client.0.smithi196.stderr:++ seq -w 00 99 2023-11-08T16:34:35.707 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.707 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-11-08T16:34:35.775 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.775 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-11-08T16:34:35.833 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.834 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-11-08T16:34:35.900 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.900 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-11-08T16:34:35.961 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:35.962 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-11-08T16:34:36.021 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.022 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-11-08T16:34:36.083 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.083 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-11-08T16:34:36.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-11-08T16:34:36.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-11-08T16:34:36.275 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.275 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-11-08T16:34:36.340 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.340 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-11-08T16:34:36.403 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.404 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-11-08T16:34:36.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-11-08T16:34:36.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-11-08T16:34:36.580 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.581 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-11-08T16:34:36.637 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.637 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-11-08T16:34:36.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-11-08T16:34:36.768 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.769 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-11-08T16:34:36.835 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.836 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-11-08T16:34:36.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-11-08T16:34:36.963 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:36.963 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-11-08T16:34:37.026 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.027 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-11-08T16:34:37.090 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.090 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-11-08T16:34:37.152 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.153 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-11-08T16:34:37.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.217 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-11-08T16:34:37.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-11-08T16:34:37.337 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.337 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-11-08T16:34:37.398 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.398 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-11-08T16:34:37.465 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.465 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-11-08T16:34:37.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-11-08T16:34:37.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-11-08T16:34:37.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-11-08T16:34:37.709 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-11-08T16:34:37.776 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.777 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-11-08T16:34:37.840 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.840 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-11-08T16:34:37.903 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.903 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-11-08T16:34:37.970 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:37.970 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-11-08T16:34:38.035 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.035 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-11-08T16:34:38.092 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.093 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-11-08T16:34:38.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.149 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-11-08T16:34:38.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-11-08T16:34:38.268 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.269 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-11-08T16:34:38.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.332 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-11-08T16:34:38.390 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.390 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-11-08T16:34:38.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-11-08T16:34:38.505 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.505 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-11-08T16:34:38.575 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.575 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-11-08T16:34:38.635 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.636 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-11-08T16:34:38.695 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.696 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-11-08T16:34:38.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-11-08T16:34:38.813 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.813 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-11-08T16:34:38.879 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.880 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-11-08T16:34:38.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:38.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-11-08T16:34:39.002 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.002 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-11-08T16:34:39.059 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.059 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-11-08T16:34:39.129 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.129 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-11-08T16:34:39.193 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.193 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-11-08T16:34:39.254 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.254 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-11-08T16:34:39.318 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.319 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-11-08T16:34:39.384 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-11-08T16:34:39.441 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.441 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-11-08T16:34:39.501 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.501 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-11-08T16:34:39.560 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.560 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-11-08T16:34:39.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.628 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-11-08T16:34:39.688 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.688 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-11-08T16:34:39.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-11-08T16:34:39.818 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.818 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-11-08T16:34:39.883 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.883 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-11-08T16:34:39.946 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:39.947 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-11-08T16:34:40.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-11-08T16:34:40.070 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.070 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-11-08T16:34:40.137 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.137 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-11-08T16:34:40.203 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.203 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-11-08T16:34:40.267 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.267 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-11-08T16:34:40.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-11-08T16:34:40.391 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.391 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-11-08T16:34:40.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-11-08T16:34:40.517 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.518 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-11-08T16:34:40.582 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.582 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-11-08T16:34:40.647 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.647 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-11-08T16:34:40.713 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.714 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-11-08T16:34:40.772 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.772 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-11-08T16:34:40.839 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.839 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-11-08T16:34:40.901 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.901 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-11-08T16:34:40.968 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:40.968 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-11-08T16:34:41.037 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.037 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-11-08T16:34:41.102 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.103 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-11-08T16:34:41.171 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.172 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-11-08T16:34:41.236 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.236 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-11-08T16:34:41.295 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.295 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-11-08T16:34:41.357 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-11-08T16:34:41.417 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-11-08T16:34:41.480 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.480 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-11-08T16:34:41.539 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.539 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-11-08T16:34:41.597 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.597 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-11-08T16:34:41.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-11-08T16:34:41.721 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.721 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-11-08T16:34:41.782 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.783 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-11-08T16:34:41.848 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.848 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-11-08T16:34:41.916 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:41.916 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-11-08T16:34:41.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:41.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 100 2023-11-08T16:34:41.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:34:42.018 INFO:tasks.workunit.client.0.smithi196.stdout:100 2023-11-08T16:34:42.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep image 2023-11-08T16:34:42.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:34:42.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 100 2023-11-08T16:34:42.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:34:42.098 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:42.091+0000 7fab35161700 0 -- 172.21.15.196:0/3347745719 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55c110ac5fa0 msgr2=0x55c110b6ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:42.107 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:42.103+0000 7fab35161700 0 -- 172.21.15.196:0/3347745719 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7fab18033ca0 msgr2=0x7fab180360d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:42.420 INFO:tasks.workunit.client.0.smithi196.stdout:100 2023-11-08T16:34:42.421 INFO:tasks.workunit.client.0.smithi196.stderr:++ seq -w 00 99 2023-11-08T16:34:42.422 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:42.422 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.00 2023-11-08T16:34:42.577 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:42.571+0000 7f0d4b620700 0 -- 172.21.15.196:0/82733342 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f0d30033ca0 msgr2=0x7f0d300360d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:34:42.581 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:42.586 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:42.587 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.01 2023-11-08T16:34:42.775 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:42.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:42.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.02 2023-11-08T16:34:42.964 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:42.969 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:42.969 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.03 2023-11-08T16:34:43.141 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:43.146 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:43.146 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.04 2023-11-08T16:34:43.325 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:43.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:43.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.05 2023-11-08T16:34:43.513 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:43.518 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:43.518 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.06 2023-11-08T16:34:43.701 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:43.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:43.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.07 2023-11-08T16:34:43.886 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:43.890 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:43.891 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.08 2023-11-08T16:34:44.066 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.070 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.071 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.09 2023-11-08T16:34:44.247 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.252 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.252 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.10 2023-11-08T16:34:44.423 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.11 2023-11-08T16:34:44.608 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.613 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.12 2023-11-08T16:34:44.780 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.786 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.786 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.13 2023-11-08T16:34:44.961 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:44.967 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:44.967 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.14 2023-11-08T16:34:45.140 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:45.145 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:45.146 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.15 2023-11-08T16:34:45.327 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:45.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:45.333 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.16 2023-11-08T16:34:45.516 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:45.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:45.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.17 2023-11-08T16:34:45.697 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:45.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:45.703 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.18 2023-11-08T16:34:45.876 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:45.880 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:45.881 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.19 2023-11-08T16:34:46.051 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.055 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.056 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.20 2023-11-08T16:34:46.229 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.233 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.21 2023-11-08T16:34:46.414 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.421 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.421 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.22 2023-11-08T16:34:46.608 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.23 2023-11-08T16:34:46.788 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.793 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.793 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.24 2023-11-08T16:34:46.975 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:46.971+0000 7f87aa0ba700 0 -- 172.21.15.196:0/3000885239 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f8790008780 msgr2=0x7f879000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:46.976 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:46.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:46.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.25 2023-11-08T16:34:47.171 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:47.176 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:47.176 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.26 2023-11-08T16:34:47.347 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:47.343+0000 7fb1098a5700 0 -- 172.21.15.196:0/2316227705 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fb0f0008780 msgr2=0x7fb0f000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:47.348 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:47.354 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:47.354 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.27 2023-11-08T16:34:47.521 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:47.525 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:47.525 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.28 2023-11-08T16:34:47.704 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:47.699+0000 7f28423f4700 0 -- 172.21.15.196:0/1137779301 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f2824033d70 msgr2=0x7f28240361a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:34:47.708 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:47.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:47.713 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.29 2023-11-08T16:34:47.888 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:47.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:47.893 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.30 2023-11-08T16:34:48.061 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.066 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.066 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.31 2023-11-08T16:34:48.248 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.252 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.252 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.32 2023-11-08T16:34:48.444 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.448 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.448 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.33 2023-11-08T16:34:48.617 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.622 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.34 2023-11-08T16:34:48.797 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:48.791+0000 7f804578e700 0 -- 172.21.15.196:0/3412401910 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55e1510d5f10 msgr2=0x55e151186890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:48.801 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.806 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.806 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.35 2023-11-08T16:34:48.989 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:48.993 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:48.993 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.36 2023-11-08T16:34:49.167 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:49.173 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:49.173 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.37 2023-11-08T16:34:49.361 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:49.366 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:49.366 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.38 2023-11-08T16:34:49.549 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:49.554 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:49.554 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.39 2023-11-08T16:34:49.742 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:49.735+0000 7fe02db47700 0 -- 172.21.15.196:0/3641637934 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fe014008780 msgr2=0x7fe01400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:49.743 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:49.747 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:49.748 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.40 2023-11-08T16:34:49.932 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:49.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:49.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.41 2023-11-08T16:34:50.112 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:50.107+0000 7fb9e5b15700 0 -- 172.21.15.196:0/3948640365 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7fb9c8033d70 msgr2=0x7fb9c80361a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:50.122 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:50.126 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:50.126 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.42 2023-11-08T16:34:50.313 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:50.318 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:50.319 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.43 2023-11-08T16:34:50.494 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:50.498 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:50.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.44 2023-11-08T16:34:50.673 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:50.677 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:50.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.45 2023-11-08T16:34:50.865 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:50.869 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:50.870 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.46 2023-11-08T16:34:51.046 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:51.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:51.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.47 2023-11-08T16:34:51.260 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:51.265 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:51.265 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.48 2023-11-08T16:34:51.461 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:51.455+0000 7fa6b805c700 0 -- 172.21.15.196:0/1291399284 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fa69c008780 msgr2=0x7fa69c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:51.463 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:51.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:51.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.49 2023-11-08T16:34:51.655 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:51.660 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:51.660 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.50 2023-11-08T16:34:51.848 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:51.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:51.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.51 2023-11-08T16:34:52.027 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.52 2023-11-08T16:34:52.204 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.208 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.209 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.53 2023-11-08T16:34:52.390 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.394 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.395 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.54 2023-11-08T16:34:52.566 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.55 2023-11-08T16:34:52.753 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.757 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.757 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.56 2023-11-08T16:34:52.934 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:52.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:52.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.57 2023-11-08T16:34:53.122 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:53.115+0000 7f245e727700 0 -- 172.21.15.196:0/1969002668 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55f20b7d5040 msgr2=0x55f20b818a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:34:53.126 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:53.131 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:53.131 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.58 2023-11-08T16:34:53.325 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:53.330 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:53.330 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.59 2023-11-08T16:34:53.511 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:53.515 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:53.516 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.60 2023-11-08T16:34:53.697 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:53.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:53.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.61 2023-11-08T16:34:53.881 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:53.886 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:53.886 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.62 2023-11-08T16:34:54.105 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:54.110 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:54.110 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.63 2023-11-08T16:34:54.308 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:54.313 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:54.313 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.64 2023-11-08T16:34:54.495 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:54.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:54.500 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.65 2023-11-08T16:34:54.681 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:54.675+0000 7f3b0689f700 0 -- 172.21.15.196:0/630724822 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x5581bb531e90 msgr2=0x5581bb555ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:54.682 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:54.686 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:54.687 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.66 2023-11-08T16:34:54.884 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:54.889 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:54.889 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.67 2023-11-08T16:34:55.072 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:55.076 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:55.076 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.68 2023-11-08T16:34:55.271 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:55.275 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:55.275 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.69 2023-11-08T16:34:55.461 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:55.466 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:55.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.70 2023-11-08T16:34:55.648 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:55.643+0000 7f9e09fe3700 0 -- 172.21.15.196:0/4218354519 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f9df00148c0 msgr2=0x7f9df0011a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:55.650 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:55.655 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:55.655 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.71 2023-11-08T16:34:55.840 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:55.845 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:55.846 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.72 2023-11-08T16:34:56.026 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.73 2023-11-08T16:34:56.226 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.230 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.230 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.74 2023-11-08T16:34:56.398 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.404 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.404 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.75 2023-11-08T16:34:56.591 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.596 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.596 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.76 2023-11-08T16:34:56.779 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.783 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.783 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.77 2023-11-08T16:34:56.969 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:56.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:56.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.78 2023-11-08T16:34:57.155 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:57.160 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:57.160 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.79 2023-11-08T16:34:57.346 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:57.350 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:57.351 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.80 2023-11-08T16:34:57.539 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:57.535+0000 7fa2a7e71700 0 -- 172.21.15.196:0/625477693 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fa28c014c80 msgr2=0x7fa28c0120a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:57.539 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:57.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:57.544 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.81 2023-11-08T16:34:57.738 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:57.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:57.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.82 2023-11-08T16:34:57.922 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:57.919+0000 7f9a51ad3700 0 -- 172.21.15.196:0/1939416993 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55e6911ac310 msgr2=0x55e691250d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:34:57.930 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:57.934 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:57.935 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.83 2023-11-08T16:34:58.111 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:58.116 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:58.117 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.84 2023-11-08T16:34:58.327 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:58.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:58.331 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.85 2023-11-08T16:34:58.518 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:58.522 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:58.522 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.86 2023-11-08T16:34:58.710 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:58.714 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:58.714 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.87 2023-11-08T16:34:58.896 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:58.891+0000 7fea5db88700 0 -- 172.21.15.196:0/1614006998 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fea40033d70 msgr2=0x7fea400361a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:58.897 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:58.902 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:58.902 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.88 2023-11-08T16:34:59.106 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:59.111 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:59.111 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.89 2023-11-08T16:34:59.320 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:34:59.315+0000 7f16a3372700 0 -- 172.21.15.196:0/1003767388 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f1680008780 msgr2=0x7f168000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:34:59.320 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:59.325 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:59.325 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.90 2023-11-08T16:34:59.514 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:59.519 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:59.519 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.91 2023-11-08T16:34:59.716 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:59.720 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:59.720 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.92 2023-11-08T16:34:59.912 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:34:59.917 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:34:59.917 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.93 2023-11-08T16:35:00.116 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:00.120 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:00.121 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.94 2023-11-08T16:35:00.330 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:00.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:00.335 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.95 2023-11-08T16:35:00.532 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:00.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:00.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.96 2023-11-08T16:35:00.732 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:00.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:00.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.97 2023-11-08T16:35:00.935 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:00.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:00.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.98 2023-11-08T16:35:01.144 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:01.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ for i in $(seq -w 00 99) 2023-11-08T16:35:01.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm image.99 2023-11-08T16:35:01.338 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:01.342 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_remove 2023-11-08T16:35:01.343 INFO:tasks.workunit.client.0.smithi196.stdout:testing remove... 2023-11-08T16:35:01.343 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing remove...' 2023-11-08T16:35:01.344 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:01.344 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:01.470 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:01.591 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:01.718 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:01.838 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:01.963 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.084 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.202 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.329 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.452 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:02.894 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.010 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.135 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.465 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.586 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.703 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.809 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:03.933 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd remove NOT_EXIST 2023-11-08T16:35:04.000 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 0% complete...failed. 2023-11-08T16:35:04.000 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: delete error: (2) No such file or directory 2023-11-08T16:35:04.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:04.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 test1 2023-11-08T16:35:04.032 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:04.044 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:04.039+0000 7ff01a233340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:04.057 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:35:04.122 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:04.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:35:04.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:04.128 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:35:04.168 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:35:04.169 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test2 2023-11-08T16:35:04.239 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:04.422 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:04.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:35:04.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:04.429 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:35:04.468 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:35:04.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 1 test1 2023-11-08T16:35:04.495 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:04.507 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:04.503+0000 7f181ac3d340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:04.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rados rm -p rbd test1.rbd 2023-11-08T16:35:04.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:35:04.609 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:04.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:35:04.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:04.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:35:04.654 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:35:04.655 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 1 -eq 0 ']' 2023-11-08T16:35:04.655 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test2 2023-11-08T16:35:04.726 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test2@snap 2023-11-08T16:35:05.420 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:35:05.433 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect test2@snap 2023-11-08T16:35:05.498 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-11-08T16:35:05.603 INFO:tasks.workunit.client.0.smithi196.stderr:+ rados -p rbd rm rbd_children 2023-11-08T16:35:05.645 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm clone 2023-11-08T16:35:05.854 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:05.846+0000 7f8d2b439700 0 -- 172.21.15.196:0/1870702249 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f8d10008780 msgr2=0x7f8d1000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:05.854 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:05.858 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:35:05.858 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep clone 2023-11-08T16:35:05.859 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:05.859 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:35:05.899 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:35:05.900 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect test2@snap 2023-11-08T16:35:05.965 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm test2@snap 2023-11-08T16:35:06.424 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:35:06.441 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:06.626 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:06.631 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_migration 2023-11-08T16:35:06.631 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing migration...' 2023-11-08T16:35:06.631 INFO:tasks.workunit.client.0.smithi196.stdout:testing migration... 2023-11-08T16:35:06.632 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:06.632 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:06.751 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:06.872 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:06.992 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.116 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.241 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.488 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.611 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.735 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.858 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:07.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.101 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.222 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.342 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.583 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:08.821 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool create rbd2 8 2023-11-08T16:35:09.527 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' already exists 2023-11-08T16:35:09.535 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd pool init rbd2 2023-11-08T16:35:12.326 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 1 -s 128M test1 2023-11-08T16:35:12.351 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:12.362 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:12.354+0000 7f0cf478e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:12.376 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:35:12.376 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'format: 1' 2023-11-08T16:35:12.420 INFO:tasks.workunit.client.0.smithi196.stdout: format: 1 2023-11-08T16:35:12.421 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 --image-format 2 2023-11-08T16:35:12.557 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state test1 2023-11-08T16:35:12.557 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=test1 2023-11-08T16:35:12.557 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status test1 2023-11-08T16:35:12.558 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:12.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ test prepared = prepared 2023-11-08T16:35:12.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:35:12.874 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'format: 2' 2023-11-08T16:35:12.934 INFO:tasks.workunit.client.0.smithi196.stdout: format: 2 2023-11-08T16:35:12.935 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:35:12.996 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:12.990+0000 7ff8b73d0340 -1 librbd::image::PreRemoveRequest: 0x5620efea7f40 validate_image_removal: image in migration state - not removing 2023-11-08T16:35:13.000 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 0% complete...failed. 2023-11-08T16:35:13.000 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: error: image still has watchers 2023-11-08T16:35:13.000 INFO:tasks.workunit.client.0.smithi196.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-11-08T16:35:13.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:13.005 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:13.187 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:13.182+0000 7f1f3be52700 0 -- 172.21.15.196:0/918038850 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f1f1c0344b0 msgr2=0x7f1f1c0368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:13.213 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:13.206+0000 7f1f3be52700 0 -- 172.21.15.196:0/918038850 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x56246a63fc40 msgr2=0x7f1f1c039690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:13.238 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:13.243 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state test1 2023-11-08T16:35:13.243 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=test1 2023-11-08T16:35:13.243 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status test1 2023-11-08T16:35:13.244 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:13.340 INFO:tasks.workunit.client.0.smithi196.stderr:+ test executed = executed 2023-11-08T16:35:13.340 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:13.515 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete...2023-11-08T16:35:13.510+0000 7f41c5554700 0 -- 172.21.15.196:0/2840110999 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f41a4004bc0 msgr2=0x7f41a4006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:13.530 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-11-08T16:35:13.526+0000 7f41c5d55700 0 -- 172.21.15.196:0/2840110999 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55fad8f1fd90 msgr2=0x55fad900bb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:13.545 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:13.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ get_migration_state test1 2023-11-08T16:35:13.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ local image=test1 2023-11-08T16:35:13.551 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --format xml status test1 2023-11-08T16:35:13.551 INFO:tasks.workunit.client.0.smithi196.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:13.605 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:13.606 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:35:13.606 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'features: .*layering' 2023-11-08T16:35:13.661 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:13.662 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-11-08T16:35:13.845 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:35:13.846 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'features: .*layering' 2023-11-08T16:35:13.914 INFO:tasks.workunit.client.0.smithi196.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-11-08T16:35:13.915 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:14.070 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:14.066+0000 7f8cf1edc700 0 -- 172.21.15.196:0/3353381521 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f8cd40344b0 msgr2=0x7f8cd40368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:14.091 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:14.086+0000 7f8cf1edc700 0 -- 172.21.15.196:0/3353381521 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x561f5f53cc40 msgr2=0x7f8cd4039650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:14.097 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:14.101 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:14.263 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:14.258+0000 7efc8d100700 0 -- 172.21.15.196:0/2614966274 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55dc719672c0 msgr2=0x55dc71a5f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:14.284 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration2023-11-08T16:35:14.278+0000 7efc8d100700 0 -- 172.21.15.196:0/2614966274 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7efc700344b0 msgr2=0x7efc700368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:14.321 INFO:tasks.workunit.client.0.smithi196.stderr:: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-11-08T16:35:14.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 rbd2/test1 2023-11-08T16:35:14.505 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:14.498+0000 7fa514832700 0 -- 172.21.15.196:0/4174243133 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55cfa5ed6380 msgr2=0x55cfa5fc27a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:14.511 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state rbd2/test1 2023-11-08T16:35:14.512 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=rbd2/test1 2023-11-08T16:35:14.512 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status rbd2/test1 2023-11-08T16:35:14.512 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:14.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ test prepared = prepared 2023-11-08T16:35:14.653 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:35:14.653 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:14.653 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:35:14.693 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:35:14.694 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls 2023-11-08T16:35:14.694 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:35:14.736 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:35:14.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:14.897 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:14.890+0000 7fb0671be700 0 -- 172.21.15.196:0/3918540623 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x561f04bcdb00 msgr2=0x561f04bcfef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:14.911 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:14.914 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state rbd2/test1 2023-11-08T16:35:14.915 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=rbd2/test1 2023-11-08T16:35:14.918 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status rbd2/test1 2023-11-08T16:35:14.919 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:15.026 INFO:tasks.workunit.client.0.smithi196.stderr:+ test executed = executed 2023-11-08T16:35:15.026 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm rbd2/test1 2023-11-08T16:35:15.094 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:15.086+0000 7fa491109700 -1 librbd::image::PreRemoveRequest: 0x5614ceae9a90 validate_image_removal: image in migration state - not removing 2023-11-08T16:35:15.106 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 0% complete...failed. 2023-11-08T16:35:15.106 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: error: image still has watchers 2023-11-08T16:35:15.106 INFO:tasks.workunit.client.0.smithi196.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-11-08T16:35:15.111 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:15.111 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:15.281 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-11-08T16:35:15.274+0000 7f7a3cf48700 0 -- 172.21.15.196:0/2713229568 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55e2b06ded90 msgr2=0x55e2b07cab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:15.298 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:15.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create rbd2/ns1 2023-11-08T16:35:15.351 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create rbd2/ns2 2023-11-08T16:35:15.398 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-11-08T16:35:15.566 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state rbd2/ns1/test1 2023-11-08T16:35:15.566 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=rbd2/ns1/test1 2023-11-08T16:35:15.567 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-11-08T16:35:15.567 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:15.711 INFO:tasks.workunit.client.0.smithi196.stderr:+ test prepared = prepared 2023-11-08T16:35:15.711 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute rbd2/test1 2023-11-08T16:35:15.836 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:15.830+0000 7fb0b232a700 0 -- 172.21.15.196:0/117733298 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55e141e18c80 msgr2=0x55e141e1b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:15.839 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:15.844 INFO:tasks.workunit.client.0.smithi196.stderr:++ get_migration_state rbd2/ns1/test1 2023-11-08T16:35:15.844 INFO:tasks.workunit.client.0.smithi196.stderr:++ local image=rbd2/ns1/test1 2023-11-08T16:35:15.844 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-11-08T16:35:15.844 INFO:tasks.workunit.client.0.smithi196.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-11-08T16:35:15.954 INFO:tasks.workunit.client.0.smithi196.stderr:+ test executed = executed 2023-11-08T16:35:15.954 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit rbd2/test1 2023-11-08T16:35:16.118 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-11-08T16:35:16.114+0000 7f5902479700 0 -- 172.21.15.196:0/2225239999 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55e7fd2802c0 msgr2=0x55e7fd378930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.129 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:16.135 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-11-08T16:35:16.307 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:16.302+0000 7f3ac8061700 0 -- 172.21.15.196:0/2453900758 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x5611cdb18d00 msgr2=0x5611cdb1b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.313 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute rbd2/ns2/test1 2023-11-08T16:35:16.432 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:16.426+0000 7f066e9a7700 0 -- 172.21.15.196:0/1553385814 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55a038cf9740 msgr2=0x55a038d9adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.446 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:16.438+0000 7f066e9a7700 0 -- 172.21.15.196:0/1553385814 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f06500344b0 msgr2=0x7f06500368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.446 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:16.449 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit rbd2/ns2/test1 2023-11-08T16:35:16.601 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:16.594+0000 7f40d73a2700 0 -- 172.21.15.196:0/4022396963 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f40b80344b0 msgr2=0x7f40b80368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.616 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:16.610+0000 7f40d73a2700 0 -- 172.21.15.196:0/4022396963 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55a839fe0eb0 msgr2=0x7f40b80395d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:16.641 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-11-08T16:35:16.647 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M test1 2023-11-08T16:35:16.685 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:16.678+0000 7f3484bcc340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:16.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-11-08T16:35:16.825 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:35:16.825 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'data_pool: rbd2' 2023-11-08T16:35:16.889 INFO:tasks.workunit.client.0.smithi196.stdout: data_pool: rbd2 2023-11-08T16:35:16.889 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:17.034 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:17.030+0000 7f30a05d2700 0 -- 172.21.15.196:0/2110490197 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55b5493a6c60 msgr2=0x55b549402c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.062 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.058+0000 7f30a05d2700 0 -- 172.21.15.196:0/2110490197 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f30800343e0 msgr2=0x7f3080036810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.071 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:17.074 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:17.240 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete...2023-11-08T16:35:17.234+0000 7f87b0aa8700 0 -- 172.21.15.196:0/1236220684 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f8790004890 msgr2=0x7f8790004cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.260 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-11-08T16:35:17.254+0000 7f87b12a9700 0 -- 172.21.15.196:0/1236220684 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55f90fe010a0 msgr2=0x55f90fef9b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.273 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:17.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 2023-11-08T16:35:17.440 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd trash mv test1 2023-11-08T16:35:17.441 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv test1 2023-11-08T16:35:17.496 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.490+0000 7fccd90fb340 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-11-08T16:35:17.500 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-11-08T16:35:17.506 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:17.508 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls -a 2023-11-08T16:35:17.508 INFO:tasks.workunit.client.0.smithi196.stderr:++ cut -d ' ' -f 1 2023-11-08T16:35:17.552 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=19d8225b896 2023-11-08T16:35:17.553 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd trash rm 19d8225b896 2023-11-08T16:35:17.553 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm 19d8225b896 2023-11-08T16:35:17.606 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.598+0000 7ff509a82700 -1 librbd::image::RefreshRequest: image being migrated 2023-11-08T16:35:17.607 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.598+0000 7ff50a283700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-11-08T16:35:17.607 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.602+0000 7ff50a283700 -1 librbd::ImageState: 0x7ff4e4048ae0 failed to open image: (30) Read-only file system 2023-11-08T16:35:17.607 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.602+0000 7ff500ff9700 -1 librbd::image::RemoveRequest: 0x7ff4e4000b80 handle_open_image: error opening image: (30) Read-only file system 2023-11-08T16:35:17.610 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: remove error: (30) Read-only file system 2023-11-08T16:35:17.611 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 0% complete...failed. 2023-11-08T16:35:17.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:17.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd trash restore 19d8225b896 2023-11-08T16:35:17.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash restore 19d8225b896 2023-11-08T16:35:17.654 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: restore error: 2023-11-08T16:35:17.650+0000 7f7d81adf340 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-11-08T16:35:17.654 INFO:tasks.workunit.client.0.smithi196.stderr:(22) Invalid argument 2023-11-08T16:35:17.659 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:17.659 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test1 2023-11-08T16:35:17.834 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:17.830+0000 7f75fdd3e700 0 -- 172.21.15.196:0/3044566485 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55b75f579270 msgr2=0x55b75f67d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.867 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:17.862+0000 7f75fdd3e700 0 -- 172.21.15.196:0/3044566485 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f75e00344a0 msgr2=0x7f75e00368d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:17.878 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:17.883 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd remove test1 2023-11-08T16:35:18.032 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:18.036 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-11-08T16:35:18.037 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd --image-format 2 import - test1 2023-11-08T16:35:18.109 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records in 2023-11-08T16:35:18.109 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records out 2023-11-08T16:35:18.109 INFO:tasks.workunit.client.0.smithi196.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0715644 s, 14.7 MB/s 2023-11-08T16:35:18.162 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 100% complete...done. 2023-11-08T16:35:18.168 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export test1 - 2023-11-08T16:35:18.169 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:18.228 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:18.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ md5sum='e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:18.238 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@snap1 2023-11-08T16:35:18.377 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:35:18.391 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect test1@snap1 2023-11-08T16:35:18.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@snap2 2023-11-08T16:35:19.429 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:35:19.443 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-11-08T16:35:19.563 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-11-08T16:35:19.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v1 2023-11-08T16:35:19.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-11-08T16:35:19.745 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd/test1@snap1 2023-11-08T16:35:19.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:19.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-11-08T16:35:19.821 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd/test1@snap2 2023-11-08T16:35:19.822 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:19.822 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'op_features: clone-child' 2023-11-08T16:35:19.895 INFO:tasks.workunit.client.0.smithi196.stdout: op_features: clone-child 2023-11-08T16:35:19.896 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v1 - 2023-11-08T16:35:19.897 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:19.972 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:19.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:19.980 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v2 - 2023-11-08T16:35:19.980 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:20.049 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:20.056 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:20.057 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children test1@snap1 2023-11-08T16:35:20.135 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-11-08T16:35:20.136 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children test1@snap2 2023-11-08T16:35:20.198 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-11-08T16:35:20.199 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test1 rbd2/test2 2023-11-08T16:35:20.368 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:20.362+0000 7f4e5a73a700 0 -- 172.21.15.196:0/1016275656 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x556e45062c70 msgr2=0x556e45151a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:22.324 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:22.318+0000 7f4e5a73a700 0 -- 172.21.15.196:0/1016275656 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f4e3c034400 msgr2=0x7f4e3c0367f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:22.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v1 2023-11-08T16:35:22.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-11-08T16:35:22.560 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd2/test2@snap1 2023-11-08T16:35:22.561 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:22.561 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-11-08T16:35:22.664 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd2/test2@snap2 2023-11-08T16:35:22.665 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:22.665 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'op_features: clone-child' 2023-11-08T16:35:22.770 INFO:tasks.workunit.client.0.smithi196.stdout: op_features: clone-child 2023-11-08T16:35:22.770 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children rbd2/test2@snap1 2023-11-08T16:35:22.881 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-11-08T16:35:22.882 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children rbd2/test2@snap2 2023-11-08T16:35:22.976 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-11-08T16:35:22.976 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:23.131 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:23.136 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd migration commit test1 2023-11-08T16:35:23.136 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:23.278 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: the image has descendants: 2023-11-08T16:35:23.278 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v1 2023-11-08T16:35:23.278 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v2 2023-11-08T16:35:23.278 INFO:tasks.workunit.client.0.smithi196.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-11-08T16:35:23.279 INFO:tasks.workunit.client.0.smithi196.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-11-08T16:35:23.284 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:23.284 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 --force 2023-11-08T16:35:23.417 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: the image has descendants: 2023-11-08T16:35:23.417 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v1 2023-11-08T16:35:23.417 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v2 2023-11-08T16:35:23.417 INFO:tasks.workunit.client.0.smithi196.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-11-08T16:35:23.418 INFO:tasks.workunit.client.0.smithi196.stderr:Proceeding anyway due to force flag set. 2023-11-08T16:35:23.441 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:23.434+0000 7f5e90264700 0 -- 172.21.15.196:0/1217147074 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f5e74034410 msgr2=0x7f5e74036840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:23.460 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:23.454+0000 7f5e90264700 0 -- 172.21.15.196:0/1217147074 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55df36e051d0 msgr2=0x7f5e740394d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:25.387 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:25.394 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v1 - 2023-11-08T16:35:25.394 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:25.462 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:25.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:25.470 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v2 - 2023-11-08T16:35:25.471 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:25.542 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:25.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:25.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare rbd2/test2 test1 2023-11-08T16:35:25.709 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:25.702+0000 7fcfe1ffe700 0 -- 172.21.15.196:0/3368534009 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7fcfb80046d0 msgr2=0x7fcfb8004b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:27.360 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:27.354+0000 7fcfe27ff700 0 -- 172.21.15.196:0/3368534009 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x5575e8531810 msgr2=0x5575e8533c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:27.490 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v1 2023-11-08T16:35:27.491 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-11-08T16:35:27.599 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd/test1@snap1 2023-11-08T16:35:27.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:27.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-11-08T16:35:27.700 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd/test1@snap2 2023-11-08T16:35:27.701 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info clone_v2 2023-11-08T16:35:27.701 INFO:tasks.workunit.client.0.smithi196.stderr:+ fgrep 'op_features: clone-child' 2023-11-08T16:35:27.809 INFO:tasks.workunit.client.0.smithi196.stdout: op_features: clone-child 2023-11-08T16:35:27.810 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children test1@snap1 2023-11-08T16:35:27.920 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-11-08T16:35:27.921 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd children test1@snap2 2023-11-08T16:35:28.020 INFO:tasks.workunit.client.0.smithi196.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-11-08T16:35:28.020 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test1 2023-11-08T16:35:28.209 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:28.213 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd migration commit test1 2023-11-08T16:35:28.213 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 2023-11-08T16:35:28.365 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: the image has descendants: 2023-11-08T16:35:28.366 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v1 2023-11-08T16:35:28.366 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v2 2023-11-08T16:35:28.366 INFO:tasks.workunit.client.0.smithi196.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-11-08T16:35:28.366 INFO:tasks.workunit.client.0.smithi196.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-11-08T16:35:28.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:28.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration commit test1 --force 2023-11-08T16:35:28.527 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: the image has descendants: 2023-11-08T16:35:28.528 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v1 2023-11-08T16:35:28.528 INFO:tasks.workunit.client.0.smithi196.stderr: rbd/clone_v2 2023-11-08T16:35:28.528 INFO:tasks.workunit.client.0.smithi196.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-11-08T16:35:28.528 INFO:tasks.workunit.client.0.smithi196.stderr:Proceeding anyway due to force flag set. 2023-11-08T16:35:28.535 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:28.530+0000 7f20e0fd1700 0 -- 172.21.15.196:0/724555104 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x561005f3dbe0 msgr2=0x561006027db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:28.559 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:28.554+0000 7f20e0fd1700 0 -- 172.21.15.196:0/724555104 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f20c00344b0 msgr2=0x7f20c00368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:30.344 INFO:tasks.workunit.client.0.smithi196.stderr: Commit image migration: 100% complete...done. 2023-11-08T16:35:30.350 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v1 - 2023-11-08T16:35:30.350 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:30.421 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:30.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:30.430 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd export clone_v2 - 2023-11-08T16:35:30.430 INFO:tasks.workunit.client.0.smithi196.stderr:++ md5sum 2023-11-08T16:35:30.501 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:30.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' = 'e83c3ac5f99d6a3412dd4ffd0f94dc79 -' 2023-11-08T16:35:30.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd remove clone_v1 2023-11-08T16:35:30.693 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:30.686+0000 7f9e7c977700 0 -- 172.21.15.196:0/1432004763 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f9e60008780 msgr2=0x7f9e6000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:30.694 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:30.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd remove clone_v2 2023-11-08T16:35:30.898 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:30.894+0000 7fc72aed7700 0 -- 172.21.15.196:0/704477309 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x556ecd51d310 msgr2=0x556ecd5c2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:30.902 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:30.907 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect test1@snap1 2023-11-08T16:35:30.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge test1 2023-11-08T16:35:32.379 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:35:32.395 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:35:32.584 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:32.578+0000 7f06e9460700 0 -- 172.21.15.196:0/925896519 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55b460f850b0 msgr2=0x55b461041350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:32.596 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:32.601 INFO:tasks.workunit.client.0.smithi196.stderr:+ for format in 1 2 2023-11-08T16:35:32.601 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 1 test2 2023-11-08T16:35:32.629 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:32.642 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:32.638+0000 7f8d72918340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:32.663 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-11-08T16:35:32.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:32.868 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:32.876 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:32.876 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:32.885 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:33.021 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:33.014+0000 7fb6ca2ae700 0 -- 172.21.15.196:0/1995020251 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x565282af2c40 msgr2=0x565282be3930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:33.040 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:33.045 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:33.098 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:33.105 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:33.105 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:33.114 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:33.200 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:33.204 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 1 test2 2023-11-08T16:35:33.231 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:33.242 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:33.234+0000 7f1706708340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:33.254 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-11-08T16:35:33.387 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:33.450 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:33.456 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:33.457 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:33.466 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test2 2023-11-08T16:35:33.627 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:33.622+0000 7f85bc324700 0 -- 172.21.15.196:0/1829367903 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f85a0008780 msgr2=0x7f85a000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:33.662 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:33.654+0000 7f85bc324700 0 -- 172.21.15.196:0/1829367903 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f859c034550 msgr2=0x7f859c036980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:33.666 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:33.669 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:33.785 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:33.778+0000 7f0634448700 0 -- 172.21.15.196:0/2717086798 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f0618034550 msgr2=0x7f0618036980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:33.819 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:33.824 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:33.878 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:33.883 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:33.883 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:33.891 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:33.970 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:33.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 1 test2 2023-11-08T16:35:33.996 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:34.007 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:34.002+0000 7f9b91cb7340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:34.020 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-11-08T16:35:34.091 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:34.086+0000 7f4ae3b7b340 -1 librbd::image::CreateRequest: 0x560033a24950 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-11-08T16:35:34.092 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:34.086+0000 7f4ae3b7b340 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-11-08T16:35:34.109 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-11-08T16:35:34.114 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:34.115 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:34.169 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:34.176 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:34.176 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:34.186 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:34.263 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:34.266 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 1 test2 2023-11-08T16:35:34.292 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:34.302 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:34.294+0000 7f6d89130340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:34.314 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 rbd2/test2 2023-11-08T16:35:34.427 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-11-08T16:35:34.497 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:34.505 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:34.506 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:34.515 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:34.644 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-11-08T16:35:34.648 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:34.698 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:34.704 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:34.704 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:34.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:34.791 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:34.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 1 test2 2023-11-08T16:35:34.819 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image format 1 is deprecated 2023-11-08T16:35:34.828 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:34.822+0000 7fc88111c340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:34.839 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 rbd2/test2 2023-11-08T16:35:34.955 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort rbd2/test2 2023-11-08T16:35:35.094 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:35.086+0000 7fc519b06700 0 -- 172.21.15.196:0/4227026159 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7fc4f4004bc0 msgr2=0x7fc4f4006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:35.112 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:35.116 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:35.169 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:35.174 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:35.174 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:35.183 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:35.254 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:35.257 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 1 = 1 2023-11-08T16:35:35.258 INFO:tasks.workunit.client.0.smithi196.stderr:+ continue 2023-11-08T16:35:35.258 INFO:tasks.workunit.client.0.smithi196.stderr:+ for format in 1 2 2023-11-08T16:35:35.258 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:35.326 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-11-08T16:35:35.511 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:35.506+0000 7fda461a5700 0 -- 172.21.15.196:0/1927881789 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7fda28034560 msgr2=0x7fda28036990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:35.525 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:35.607 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:35.620 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:35.620 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 83.3353 bytes/sec: 83 KiB/s 2023-11-08T16:35:35.635 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:35.829 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:35.822+0000 7f8e91572700 0 -- 172.21.15.196:0/3103330298 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f8e6c006f40 msgr2=0x7f8e6c0147c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:35.830 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:35.834 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:35.904 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:35.908 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:35.909 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:35.924 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:36.130 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:36.122+0000 7f109f5d8700 0 -- 172.21.15.196:0/2296145216 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f1084008780 msgr2=0x7f108400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:36.135 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:36.140 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:36.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-11-08T16:35:36.402 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:36.394+0000 7f5e4f9e9700 0 -- 172.21.15.196:0/4260554518 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f5e28008780 msgr2=0x7f5e2800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:36.407 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:36.487 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:36.497 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:36.498 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:36.512 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration execute test2 2023-11-08T16:35:36.696 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-11-08T16:35:36.690+0000 7fac1935b700 0 -- 172.21.15.196:0/2892651722 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fabf4008780 msgr2=0x7fabf400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:36.726 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:36.718+0000 7fac1935b700 0 -- 172.21.15.196:0/2892651722 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fabfc034630 msgr2=0x7fabfc036a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:36.736 INFO:tasks.workunit.client.0.smithi196.stderr: Image migration: 100% complete...done. 2023-11-08T16:35:36.741 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:36.953 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-11-08T16:35:36.946+0000 7f5a9e266700 0 -- 172.21.15.196:0/3192331047 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f5a84008780 msgr2=0x7f5a8400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:36.959 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 100% complete...done. 2023-11-08T16:35:36.964 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:37.039 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:37.042 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:37.042 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:37.059 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:37.271 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:37.266+0000 7f564ed0a700 0 -- 172.21.15.196:0/3083141623 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f5634008780 msgr2=0x7f563400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:37.273 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:37.278 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:37.349 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-11-08T16:35:37.470 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:37.462+0000 7f9dba7a9340 -1 librbd::image::CreateRequest: 0x563c52ac9950 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-11-08T16:35:37.470 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:37.462+0000 7f9dba7a9340 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-11-08T16:35:37.523 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-11-08T16:35:37.528 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:37.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:37.597 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:37.605 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:37.606 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:37.622 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:37.844 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:37.838+0000 7fc645e87700 0 -- 172.21.15.196:0/2827647309 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fc62c014c40 msgr2=0x7fc62c011db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:35:37.846 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:37.850 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:37.919 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 rbd2/test2 2023-11-08T16:35:38.096 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-11-08T16:35:38.176 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:38.185 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:38.185 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:38.198 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:38.369 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-11-08T16:35:38.373 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:38.440 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:38.444 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:38.445 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:38.461 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:38.668 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:38.662+0000 7f349315b700 0 -- 172.21.15.196:0/2062638997 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f34780122c0 msgr2=0x7f3478012700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:38.669 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:38.673 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:38.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 rbd2/test2 2023-11-08T16:35:38.913 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:38.906+0000 7fc89601f700 0 -- 172.21.15.196:0/147568826 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55e0df564760 msgr2=0x55e0df669b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:38.918 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort rbd2/test2 2023-11-08T16:35:39.093 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-11-08T16:35:39.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:39.169 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:39.182 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:39.182 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 83.3353 bytes/sec: 83 KiB/s 2023-11-08T16:35:39.199 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:39.402 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:39.398+0000 7ff235c2f700 0 -- 172.21.15.196:0/4128481511 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55f059f095d0 msgr2=0x55f059f29a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:39.404 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:39.409 INFO:tasks.workunit.client.0.smithi196.stderr:+ test 2 = 1 2023-11-08T16:35:39.410 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 128M --image-format 2 test2 2023-11-08T16:35:39.482 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-11-08T16:35:39.653 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:39.646+0000 7f3b91a47700 0 -- 172.21.15.196:0/3012994614 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x560c0b932fe0 msgr2=0x560c0b9d9bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:39.660 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-11-08T16:35:39.735 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:39.743 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:39.743 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-11-08T16:35:39.756 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd migration abort test2 2023-11-08T16:35:39.933 INFO:tasks.workunit.client.0.smithi196.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-11-08T16:35:39.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-11-08T16:35:40.007 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-11-08T16:35:40.011 INFO:tasks.workunit.client.0.smithi196.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-11-08T16:35:40.011 INFO:tasks.workunit.client.0.smithi196.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-11-08T16:35:40.026 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:35:40.235 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:35:40.230+0000 7f70a5309700 0 -- 172.21.15.196:0/2497093533 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f7080008780 msgr2=0x7f708000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:40.235 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:40.239 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:40.239 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.369 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.492 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.618 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.733 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:40.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.104 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.227 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.354 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.477 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.723 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.848 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:41.974 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:42.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:42.224 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:42.341 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:42.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-11-08T16:35:43.520 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' does not exist 2023-11-08T16:35:43.528 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_config 2023-11-08T16:35:43.529 INFO:tasks.workunit.client.0.smithi196.stdout:testing config... 2023-11-08T16:35:43.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing config...' 2023-11-08T16:35:43.530 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:43.530 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:43.659 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:43.782 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:43.912 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.041 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.163 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.289 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.411 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.659 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.784 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:44.910 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.149 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.275 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.401 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.865 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:45.994 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-11-08T16:35:45.994 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set osd rbd_cache true 2023-11-08T16:35:46.019 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-11-08T16:35:46.021 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.021 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-11-08T16:35:46.021 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set global debug_ms 10 2023-11-08T16:35:46.050 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: not rbd option: debug_ms 2023-11-08T16:35:46.052 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.052 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-11-08T16:35:46.053 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-11-08T16:35:46.078 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-11-08T16:35:46.079 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-11-08T16:35:46.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set global rbd_cache INVALID 2023-11-08T16:35:46.117 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-11-08T16:35:46.120 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.121 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set global rbd_cache false 2023-11-08T16:35:46.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set client rbd_cache true 2023-11-08T16:35:46.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global set client.123 rbd_cache false 2023-11-08T16:35:46.265 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global get global rbd_cache 2023-11-08T16:35:46.265 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^false$' 2023-11-08T16:35:46.305 INFO:tasks.workunit.client.0.smithi196.stdout:false 2023-11-08T16:35:46.306 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global get client rbd_cache 2023-11-08T16:35:46.306 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^true$' 2023-11-08T16:35:46.349 INFO:tasks.workunit.client.0.smithi196.stdout:true 2023-11-08T16:35:46.350 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^false$' 2023-11-08T16:35:46.350 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global get client.123 rbd_cache 2023-11-08T16:35:46.384 INFO:tasks.workunit.client.0.smithi196.stdout:false 2023-11-08T16:35:46.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-11-08T16:35:46.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-11-08T16:35:46.415 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: rbd_cache is not set 2023-11-08T16:35:46.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.419 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global list global 2023-11-08T16:35:46.419 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * false * global *$' 2023-11-08T16:35:46.456 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache false global 2023-11-08T16:35:46.457 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global list client 2023-11-08T16:35:46.457 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * client *$' 2023-11-08T16:35:46.493 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true client 2023-11-08T16:35:46.495 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global list client.123 2023-11-08T16:35:46.495 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-11-08T16:35:46.536 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache false client.123 2023-11-08T16:35:46.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global list client.UNKNOWN 2023-11-08T16:35:46.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * client *$' 2023-11-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true client 2023-11-08T16:35:46.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global rm client rbd_cache 2023-11-08T16:35:46.620 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config global get client rbd_cache 2023-11-08T16:35:46.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global get client rbd_cache 2023-11-08T16:35:46.658 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: rbd_cache is not set 2023-11-08T16:35:46.663 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:46.663 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global list client 2023-11-08T16:35:46.664 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * false * global *$' 2023-11-08T16:35:46.700 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache false global 2023-11-08T16:35:46.701 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global rm client.123 rbd_cache 2023-11-08T16:35:46.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config global rm global rbd_cache 2023-11-08T16:35:46.792 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool set rbd rbd_cache true 2023-11-08T16:35:46.842 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool list rbd 2023-11-08T16:35:46.846 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * pool *$' 2023-11-08T16:35:46.879 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true pool 2023-11-08T16:35:46.880 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool get rbd rbd_cache 2023-11-08T16:35:46.880 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^true$' 2023-11-08T16:35:46.920 INFO:tasks.workunit.client.0.smithi196.stdout:true 2023-11-08T16:35:46.920 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 1 test1 2023-11-08T16:35:46.957 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:46.950+0000 7fe650e0e340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:46.971 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image list rbd/test1 2023-11-08T16:35:46.972 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * pool *$' 2023-11-08T16:35:47.031 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true pool 2023-11-08T16:35:47.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-11-08T16:35:47.102 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image list rbd/test1 2023-11-08T16:35:47.102 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * false * image *$' 2023-11-08T16:35:47.164 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache false image 2023-11-08T16:35:47.165 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-11-08T16:35:47.165 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^false$' 2023-11-08T16:35:47.228 INFO:tasks.workunit.client.0.smithi196.stdout:false 2023-11-08T16:35:47.228 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-11-08T16:35:47.295 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-11-08T16:35:47.296 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-11-08T16:35:47.344 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: rbd_cache is not set 2023-11-08T16:35:47.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:47.352 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config image list rbd/test1 2023-11-08T16:35:47.353 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * pool *$' 2023-11-08T16:35:47.409 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true pool 2023-11-08T16:35:47.410 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool remove rbd rbd_cache 2023-11-08T16:35:47.462 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-11-08T16:35:47.463 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool get rbd rbd_cache 2023-11-08T16:35:47.497 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: rbd_cache is not set 2023-11-08T16:35:47.502 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:35:47.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd config pool list rbd 2023-11-08T16:35:47.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^rbd_cache * true * config *$' 2023-11-08T16:35:47.543 INFO:tasks.workunit.client.0.smithi196.stdout:rbd_cache true config 2023-11-08T16:35:47.544 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:35:47.609 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:47.613 INFO:tasks.workunit.client.0.smithi196.stderr:+ RBD_CREATE_ARGS= 2023-11-08T16:35:47.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_others 2023-11-08T16:35:47.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-11-08T16:35:47.614 INFO:tasks.workunit.client.0.smithi196.stdout:testing import, export, resize, and snapshots... 2023-11-08T16:35:47.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-11-08T16:35:47.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:47.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:47.729 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:47.857 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:47.988 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.117 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.231 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.354 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.480 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.603 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.727 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.857 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:48.982 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.100 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.219 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.346 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.594 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.722 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:49.843 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-11-08T16:35:49.844 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-11-08T16:35:49.845 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records in 2023-11-08T16:35:49.846 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records out 2023-11-08T16:35:49.846 INFO:tasks.workunit.client.0.smithi196.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000189872 s, 5.4 MB/s 2023-11-08T16:35:49.846 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-11-08T16:35:49.847 INFO:tasks.workunit.client.0.smithi196.stderr:10+0 records in 2023-11-08T16:35:49.848 INFO:tasks.workunit.client.0.smithi196.stderr:10+0 records out 2023-11-08T16:35:49.848 INFO:tasks.workunit.client.0.smithi196.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000201039 s, 50.9 MB/s 2023-11-08T16:35:49.848 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-11-08T16:35:49.849 INFO:tasks.workunit.client.0.smithi196.stderr:70+1 records in 2023-11-08T16:35:49.849 INFO:tasks.workunit.client.0.smithi196.stderr:70+1 records out 2023-11-08T16:35:49.849 INFO:tasks.workunit.client.0.smithi196.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000360523 s, 200 MB/s 2023-11-08T16:35:49.850 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-11-08T16:35:49.852 INFO:tasks.workunit.client.0.smithi196.stderr:138+1 records in 2023-11-08T16:35:49.852 INFO:tasks.workunit.client.0.smithi196.stderr:138+1 records out 2023-11-08T16:35:49.852 INFO:tasks.workunit.client.0.smithi196.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.0010611 s, 134 MB/s 2023-11-08T16:35:49.852 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-11-08T16:35:49.854 INFO:tasks.workunit.client.0.smithi196.stderr:74+1 records in 2023-11-08T16:35:49.854 INFO:tasks.workunit.client.0.smithi196.stderr:74+1 records out 2023-11-08T16:35:49.854 INFO:tasks.workunit.client.0.smithi196.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.00062144 s, 123 MB/s 2023-11-08T16:35:49.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import /tmp/img1 testimg1 2023-11-08T16:35:49.894 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:49.886+0000 7faa747d3340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:50.007 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-11-08T16:35:50.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-11-08T16:35:50.057 INFO:tasks.workunit.client.0.smithi196.stderr: Resizing image: 100% complete...done. 2023-11-08T16:35:50.064 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img2 2023-11-08T16:35:50.209 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:50.215 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1 --snap=snap1 2023-11-08T16:35:50.318 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:35:50.326 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=128 2023-11-08T16:35:50.373 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-11-08T16:35:50.380 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:35:50.380 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-11-08T16:35:50.462 INFO:tasks.workunit.client.0.smithi196.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-11-08T16:35:50.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img3 2023-11-08T16:35:50.554 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:50.557 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:35:50.558 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:50.598 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:50.599 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:35:50.599 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:50.649 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:50.649 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-11-08T16:35:50.650 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-11-08T16:35:50.794 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:50.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-11-08T16:35:50.879 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:35:50.882 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --size=1 testimg-diff1 2023-11-08T16:35:50.912 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:50.905+0000 7fdf697ce340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:50.923 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-11-08T16:35:51.327 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-11-08T16:35:51.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-11-08T16:35:51.406 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-11-08T16:35:51.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:35:51.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:51.458 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:51.459 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:35:51.459 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:51.505 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:51.506 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff1 2023-11-08T16:35:51.506 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:51.554 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:51.554 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-11-08T16:35:51.555 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:51.607 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:51.607 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-11-08T16:35:51.746 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:35:51.749 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg1 testimg3 2023-11-08T16:35:51.874 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:35:51.878 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-11-08T16:35:52.011 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:35:52.015 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-11-08T16:35:52.135 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:35:52.139 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg2 2023-11-08T16:35:52.140 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:52.192 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:52.193 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:35:52.194 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:52.246 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:52.246 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:52.247 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff2 2023-11-08T16:35:52.302 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:52.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff3 2023-11-08T16:35:52.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:52.362 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:52.362 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy testimg1 testimg4 2023-11-08T16:35:53.407 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:35:53.411 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-11-08T16:35:54.424 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:35:54.429 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg4 2023-11-08T16:35:54.429 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:35:54.480 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:35:54.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg5 2023-11-08T16:35:54.481 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:54.541 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:54.542 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg4 2023-11-08T16:35:54.542 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:35:54.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:35:54.543 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:35:54.599 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:35:54.600 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg4 2023-11-08T16:35:54.601 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '.*snap1.*' 2023-11-08T16:35:54.653 INFO:tasks.workunit.client.0.smithi196.stdout: 18 snap1 256 MiB Wed Nov 8 16:35:53 2023 2023-11-08T16:35:54.653 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img1.new 2023-11-08T16:35:54.746 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:54.749 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg2 /tmp/img2.new 2023-11-08T16:35:54.885 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:54.890 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg3 /tmp/img3.new 2023-11-08T16:35:54.976 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:54.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-11-08T16:35:55.076 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:55.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-11-08T16:35:55.235 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:55.239 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-11-08T16:35:55.337 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:55.341 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-11-08T16:35:55.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-11-08T16:35:55.687 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-11-08T16:35:55.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-11-08T16:35:55.990 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-11-08T16:35:56.110 INFO:tasks.workunit.client.0.smithi196.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-11-08T16:35:56.117 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-11-08T16:35:56.230 INFO:tasks.workunit.client.0.smithi196.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-11-08T16:35:56.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:35:56.237 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:56.275 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:56.276 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff1 2023-11-08T16:35:56.276 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:35:56.326 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:35:56.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-11-08T16:35:56.460 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:56.463 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-11-08T16:35:56.582 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:35:56.585 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-11-08T16:35:56.776 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-11-08T16:35:56.968 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg2 2023-11-08T16:35:57.117 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-11-08T16:35:57.109+0000 7f8c9759b700 0 -- 172.21.15.196:0/3771671836 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x5620fc5397c0 msgr2=0x5620fc4eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:35:57.140 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:35:57.145 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg3 2023-11-08T16:35:57.308 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-11-08T16:35:57.312 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create testimg2 -s 0 2023-11-08T16:35:57.351 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:35:57.345+0000 7fb9b56b8340 -1 librbd: Forced V1 image creation. 2023-11-08T16:35:57.372 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd cp testimg2 testimg3 2023-11-08T16:35:57.464 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete...done. 2023-11-08T16:35:57.470 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep cp testimg2 testimg6 2023-11-08T16:35:57.560 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 100% complete...done. 2023-11-08T16:35:57.567 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-11-08T16:35:57.683 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:35:57.690 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-11-08T16:35:58.691 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:35:58.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:35:58.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-11-08T16:35:58.739 INFO:tasks.workunit.client.0.smithi196.stdout:error setting snapshot context: (2) No such file or directory 2023-11-08T16:35:58.739 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-11-08T16:35:58.739 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-11-08T16:35:58.786 INFO:tasks.workunit.client.0.smithi196.stdout:error setting snapshot context: (2) No such file or directory 2023-11-08T16:35:58.787 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd sparsify testimg1 2023-11-08T16:35:58.917 INFO:tasks.workunit.client.0.smithi196.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-11-08T16:35:58.926 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:35:58.926 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:59.084 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:59.409 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:35:59.624 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:00.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:01.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.264 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.517 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.867 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:02.996 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.112 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.238 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.491 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.619 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.746 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:03.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-11-08T16:36:03.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_locking 2023-11-08T16:36:03.979 INFO:tasks.workunit.client.0.smithi196.stdout:testing locking... 2023-11-08T16:36:03.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing locking...' 2023-11-08T16:36:03.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:03.980 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.104 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.231 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.486 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.607 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.734 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.858 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:04.991 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.116 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.244 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.493 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.734 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.861 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:05.986 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:06.114 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:06.246 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create -s 1 test1 2023-11-08T16:36:06.286 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:06.285+0000 7f2ba7bf2340 -1 librbd: Forced V1 image creation. 2023-11-08T16:36:06.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:06.303 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:06.304 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:06.351 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:06.351 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id 2023-11-08T16:36:06.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:06.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 1 ' 2023-11-08T16:36:06.459 INFO:tasks.workunit.client.0.smithi196.stdout:There is 1 exclusive lock on this image. 2023-11-08T16:36:06.460 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd lock list test1 2023-11-08T16:36:06.461 INFO:tasks.workunit.client.0.smithi196.stderr:++ tail -n 1 2023-11-08T16:36:06.461 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{print $1;}' 2023-11-08T16:36:06.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ LOCKER=client.7760 2023-11-08T16:36:06.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock remove test1 id client.7760 2023-11-08T16:36:07.338 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:07.338 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:07.339 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:07.389 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:07.390 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id --shared tag 2023-11-08T16:36:07.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:07.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 1 ' 2023-11-08T16:36:07.503 INFO:tasks.workunit.client.0.smithi196.stdout:There is 1 shared lock on this image. 2023-11-08T16:36:07.504 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id --shared tag 2023-11-08T16:36:07.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 2 ' 2023-11-08T16:36:07.569 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:07.618 INFO:tasks.workunit.client.0.smithi196.stdout:There are 2 shared locks on this image. 2023-11-08T16:36:07.618 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id2 --shared tag 2023-11-08T16:36:07.684 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:07.684 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 3 ' 2023-11-08T16:36:07.735 INFO:tasks.workunit.client.0.smithi196.stdout:There are 3 shared locks on this image. 2023-11-08T16:36:07.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:07.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ tail -n 1 2023-11-08T16:36:07.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ awk '{print $2, $1;}' 2023-11-08T16:36:07.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ xargs rbd lock remove test1 2023-11-08T16:36:08.347 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:36:08.347 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -qE 'features:.*exclusive' 2023-11-08T16:36:08.397 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:36:08.464 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:08.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_thick_provision 2023-11-08T16:36:08.470 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing thick provision...' 2023-11-08T16:36:08.470 INFO:tasks.workunit.client.0.smithi196.stdout:testing thick provision... 2023-11-08T16:36:08.471 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:08.471 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:08.601 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:08.733 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.068 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.206 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.341 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.466 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.588 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.835 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:09.966 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.226 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.483 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.604 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.737 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.866 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:10.997 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --thick-provision -s 64M test1 2023-11-08T16:36:11.040 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:11.037+0000 7fcd20caf340 -1 librbd: Forced V1 image creation. 2023-11-08T16:36:11.346 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-11-08T16:36:11.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ count=0 2023-11-08T16:36:11.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret= 2023-11-08T16:36:11.355 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 -lt 10 ']' 2023-11-08T16:36:11.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:36:11.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:36:11.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr -s ' ' 2023-11-08T16:36:11.357 INFO:tasks.workunit.client.0.smithi196.stderr:+ cut -d ' ' -f 4-5 2023-11-08T16:36:11.357 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^64 MiB' 2023-11-08T16:36:11.387 INFO:tasks.workunit.client.0.smithi196.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-11-08T16:36:11.395 INFO:tasks.workunit.client.0.smithi196.stdout:64 MiB 2023-11-08T16:36:11.395 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret=0 2023-11-08T16:36:11.396 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 = 0 ']' 2023-11-08T16:36:11.396 INFO:tasks.workunit.client.0.smithi196.stderr:+ break 2023-11-08T16:36:11.396 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:36:11.437 INFO:tasks.workunit.client.0.smithi196.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-11-08T16:36:11.441 INFO:tasks.workunit.client.0.smithi196.stdout:NAME PROVISIONED USED 2023-11-08T16:36:11.441 INFO:tasks.workunit.client.0.smithi196.stdout:test1 64 MiB 64 MiB 2023-11-08T16:36:11.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 '!=' 0 ']' 2023-11-08T16:36:11.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:36:11.542 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-11-08T16:36:11.546 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:36:11.546 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:36:11.547 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:11.547 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:11.579 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:11.579 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --thick-provision -s 4G test1 2023-11-08T16:36:11.614 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:11.609+0000 7f53ad248340 -1 librbd: Forced V1 image creation. 2023-11-08T16:36:12.596 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-11-08T16:36:12.593+0000 7f53abe77700 0 -- 172.21.15.196:0/1995207945 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x56302b60ba00 msgr2=0x56302b6aa5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:12.834 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete...2023-11-08T16:36:12.833+0000 7f53ab676700 0 -- 172.21.15.196:0/1995207945 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x56302b6ac8a0 msgr2=0x56302b6aec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:21.640 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-11-08T16:36:21.650 INFO:tasks.workunit.client.0.smithi196.stderr:+ count=0 2023-11-08T16:36:21.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret= 2023-11-08T16:36:21.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 -lt 10 ']' 2023-11-08T16:36:21.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:36:21.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:36:21.651 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr -s ' ' 2023-11-08T16:36:21.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ cut -d ' ' -f 4-5 2023-11-08T16:36:21.652 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^4 GiB' 2023-11-08T16:36:21.694 INFO:tasks.workunit.client.0.smithi196.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-11-08T16:36:21.729 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:21.725+0000 7f34e3a37700 0 -- 172.21.15.196:0/4018977503 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55ee1b06d080 msgr2=0x55ee1b07c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:36:21.733 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:21.729+0000 7f34e3236700 0 -- 172.21.15.196:0/4018977503 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55ee1b07fdb0 msgr2=0x55ee1b0821a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:21.917 INFO:tasks.workunit.client.0.smithi196.stdout:4 GiB 2023-11-08T16:36:21.918 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret=0 2023-11-08T16:36:21.918 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 = 0 ']' 2023-11-08T16:36:21.919 INFO:tasks.workunit.client.0.smithi196.stderr:+ break 2023-11-08T16:36:21.919 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:36:21.951 INFO:tasks.workunit.client.0.smithi196.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-11-08T16:36:21.969 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:21.965+0000 7f52af2f9700 0 -- 172.21.15.196:0/1172844588 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55568173faa0 msgr2=0x5556817cf750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:21.972 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:21.969+0000 7f52af2f9700 0 -- 172.21.15.196:0/1172844588 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x5556817f15a0 msgr2=0x7f5294036950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:22.124 INFO:tasks.workunit.client.0.smithi196.stdout:NAME PROVISIONED USED 2023-11-08T16:36:22.125 INFO:tasks.workunit.client.0.smithi196.stdout:test1 4 GiB 4 GiB 2023-11-08T16:36:22.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 '!=' 0 ']' 2023-11-08T16:36:22.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:36:22.275 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete...2023-11-08T16:36:22.273+0000 7fa66f755700 0 -- 172.21.15.196:0/726313808 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55a46ab78cf0 msgr2=0x55a46ab7b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:36:22.296 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 11% complete... Removing image: 12% complete...2023-11-08T16:36:22.293+0000 7fa66ff56700 0 -- 172.21.15.196:0/726313808 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55a46aad65b0 msgr2=0x55a46ab77f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:23.214 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-11-08T16:36:23.217 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:36:23.218 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:36:23.218 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:23.218 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:23.246 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:23.247 INFO:tasks.workunit.client.0.smithi196.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-11-08T16:36:23.247 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_others 2023-11-08T16:36:23.247 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-11-08T16:36:23.248 INFO:tasks.workunit.client.0.smithi196.stdout:testing import, export, resize, and snapshots... 2023-11-08T16:36:23.248 INFO:tasks.workunit.client.0.smithi196.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-11-08T16:36:23.249 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:23.249 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.362 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.479 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.594 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.716 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.845 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:23.972 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.227 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.487 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.745 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.874 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:24.994 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:25.122 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:25.254 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:25.383 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:25.509 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-11-08T16:36:25.511 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-11-08T16:36:25.512 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records in 2023-11-08T16:36:25.513 INFO:tasks.workunit.client.0.smithi196.stderr:1+0 records out 2023-11-08T16:36:25.513 INFO:tasks.workunit.client.0.smithi196.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000159692 s, 6.4 MB/s 2023-11-08T16:36:25.513 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-11-08T16:36:25.514 INFO:tasks.workunit.client.0.smithi196.stderr:10+0 records in 2023-11-08T16:36:25.514 INFO:tasks.workunit.client.0.smithi196.stderr:10+0 records out 2023-11-08T16:36:25.514 INFO:tasks.workunit.client.0.smithi196.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000122225 s, 83.8 MB/s 2023-11-08T16:36:25.514 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-11-08T16:36:25.515 INFO:tasks.workunit.client.0.smithi196.stderr:70+1 records in 2023-11-08T16:36:25.515 INFO:tasks.workunit.client.0.smithi196.stderr:70+1 records out 2023-11-08T16:36:25.516 INFO:tasks.workunit.client.0.smithi196.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000472285 s, 153 MB/s 2023-11-08T16:36:25.516 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-11-08T16:36:25.518 INFO:tasks.workunit.client.0.smithi196.stderr:138+1 records in 2023-11-08T16:36:25.518 INFO:tasks.workunit.client.0.smithi196.stderr:138+1 records out 2023-11-08T16:36:25.518 INFO:tasks.workunit.client.0.smithi196.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.000925854 s, 154 MB/s 2023-11-08T16:36:25.518 INFO:tasks.workunit.client.0.smithi196.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-11-08T16:36:25.520 INFO:tasks.workunit.client.0.smithi196.stderr:74+1 records in 2023-11-08T16:36:25.520 INFO:tasks.workunit.client.0.smithi196.stderr:74+1 records out 2023-11-08T16:36:25.520 INFO:tasks.workunit.client.0.smithi196.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000662186 s, 115 MB/s 2023-11-08T16:36:25.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-11-08T16:36:25.708 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-11-08T16:36:25.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-11-08T16:36:25.776 INFO:tasks.workunit.client.0.smithi196.stderr: Resizing image: 100% complete...done. 2023-11-08T16:36:25.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img2 2023-11-08T16:36:25.932 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:25.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1 --snap=snap1 2023-11-08T16:36:26.167 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:26.165+0000 7fb7704a1700 0 --2- 172.21.15.196:0/2051519610 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb750001e40 0x7fb750004230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-11-08T16:36:26.346 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:36:26.359 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=128 2023-11-08T16:36:26.414 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-11-08T16:36:26.422 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:36:26.423 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-11-08T16:36:26.496 INFO:tasks.workunit.client.0.smithi196.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-11-08T16:36:26.509 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img3 2023-11-08T16:36:26.618 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:26.622 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:36:26.623 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:26.674 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:26.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:36:26.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:26.734 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:26.734 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-11-08T16:36:26.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-11-08T16:36:26.831 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:26.835 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-11-08T16:36:26.891 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 100% complete...done. 2023-11-08T16:36:26.894 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-11-08T16:36:26.953 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-11-08T16:36:27.357 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-11-08T16:36:27.373 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-11-08T16:36:27.450 INFO:tasks.workunit.client.0.smithi196.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-11-08T16:36:27.465 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:36:27.466 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:27.703 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:27.701+0000 7f7b2fbca700 0 --2- 172.21.15.196:0/127058696 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56357429f240 0x563574334b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-11-08T16:36:27.735 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:27.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:36:27.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:27.795 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:27.796 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff1 2023-11-08T16:36:27.796 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:27.852 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:27.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-11-08T16:36:27.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:27.912 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:27.912 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-11-08T16:36:28.063 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:36:28.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg1 testimg3 2023-11-08T16:36:28.215 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:36:28.219 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-11-08T16:36:28.358 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:36:28.361 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-11-08T16:36:28.504 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-11-08T16:36:28.509 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg2 2023-11-08T16:36:28.510 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:28.562 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:28.563 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:36:28.564 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:28.618 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:28.619 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff2 2023-11-08T16:36:28.619 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:28.674 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:28.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff3 2023-11-08T16:36:28.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:28.731 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:28.732 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy testimg1 testimg4 2023-11-08T16:36:29.434 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:36:29.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-11-08T16:36:30.440 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:36:30.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 128 MiB' 2023-11-08T16:36:30.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg4 2023-11-08T16:36:30.498 INFO:tasks.workunit.client.0.smithi196.stdout: size 128 MiB in 32 objects 2023-11-08T16:36:30.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg5 2023-11-08T16:36:30.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:30.566 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:30.567 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg4 2023-11-08T16:36:30.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:36:30.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:36:30.569 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:30.620 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:36:30.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '.*snap1.*' 2023-11-08T16:36:30.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg4 2023-11-08T16:36:30.682 INFO:tasks.workunit.client.0.smithi196.stdout: 26 snap1 256 MiB Wed Nov 8 16:36:29 2023 2023-11-08T16:36:30.685 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img1.new 2023-11-08T16:36:30.793 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:30.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg2 /tmp/img2.new 2023-11-08T16:36:30.928 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:30.932 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg3 /tmp/img3.new 2023-11-08T16:36:31.024 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:31.028 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-11-08T16:36:31.125 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:31.129 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-11-08T16:36:31.254 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:31.258 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-11-08T16:36:31.358 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:31.362 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-11-08T16:36:31.589 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-11-08T16:36:31.707 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-11-08T16:36:31.907 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-11-08T16:36:32.008 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-11-08T16:36:32.159 INFO:tasks.workunit.client.0.smithi196.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-11-08T16:36:32.170 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-11-08T16:36:32.301 INFO:tasks.workunit.client.0.smithi196.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-11-08T16:36:32.314 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg1 2023-11-08T16:36:32.315 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:32.360 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:32.361 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg-diff1 2023-11-08T16:36:32.362 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:36:32.410 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:36:32.410 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-11-08T16:36:32.544 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:32.548 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-11-08T16:36:32.693 INFO:tasks.workunit.client.0.smithi196.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-11-08T16:36:32.697 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-11-08T16:36:32.883 INFO:tasks.workunit.client.0.smithi196.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-11-08T16:36:33.077 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg2 2023-11-08T16:36:33.284 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-11-08T16:36:33.281+0000 7f8823886700 0 -- 172.21.15.196:0/1268239915 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x563d877f40b0 msgr2=0x563d878afe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:33.291 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:33.294 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg3 2023-11-08T16:36:33.488 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-11-08T16:36:33.485+0000 7f865bc8c700 0 -- 172.21.15.196:0/2039409920 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f8640008780 msgr2=0x7f864000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:33.496 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:33.500 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create testimg2 -s 0 2023-11-08T16:36:33.539 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:33.537+0000 7fd8ba4f9340 -1 librbd: Forced V1 image creation. 2023-11-08T16:36:33.582 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd cp testimg2 testimg3 2023-11-08T16:36:33.634 INFO:tasks.workunit.client.0.smithi196.stderr: Image copy: 100% complete...done. 2023-11-08T16:36:33.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep cp testimg2 testimg6 2023-11-08T16:36:33.730 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 100% complete...done. 2023-11-08T16:36:33.735 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-11-08T16:36:34.382 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:36:34.400 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-11-08T16:36:35.394 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:36:35.406 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg1 2023-11-08T16:36:35.407 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-11-08T16:36:35.458 INFO:tasks.workunit.client.0.smithi196.stdout:error setting snapshot context: (2) No such file or directory 2023-11-08T16:36:35.458 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-11-08T16:36:35.459 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-11-08T16:36:35.514 INFO:tasks.workunit.client.0.smithi196.stdout:error setting snapshot context: (2) No such file or directory 2023-11-08T16:36:35.515 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd sparsify testimg1 2023-11-08T16:36:35.609 INFO:tasks.workunit.client.0.smithi196.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-11-08T16:36:35.620 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:35.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:35.893 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:36.016 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:36.234 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:36.623 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:37.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:37.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:38.135 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:38.405 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:38.679 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:38.815 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:38.941 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.074 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.202 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.465 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.597 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.735 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:39.866 INFO:tasks.workunit.client.0.smithi196.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-11-08T16:36:39.971 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_locking 2023-11-08T16:36:39.972 INFO:tasks.workunit.client.0.smithi196.stdout:testing locking... 2023-11-08T16:36:39.972 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing locking...' 2023-11-08T16:36:39.972 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:39.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.091 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.223 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.358 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.493 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.622 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:40.881 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.221 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.353 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.482 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.605 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.740 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.871 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:41.996 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:42.124 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:42.256 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:42.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:42.518 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:36:42.591 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:42.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:42.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:42.638 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:42.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id 2023-11-08T16:36:42.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:42.703 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 1 ' 2023-11-08T16:36:42.758 INFO:tasks.workunit.client.0.smithi196.stdout:There is 1 exclusive lock on this image. 2023-11-08T16:36:42.760 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd lock list test1 2023-11-08T16:36:42.760 INFO:tasks.workunit.client.0.smithi196.stderr:++ tail -n 1 2023-11-08T16:36:42.761 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{print $1;}' 2023-11-08T16:36:42.818 INFO:tasks.workunit.client.0.smithi196.stderr:+ LOCKER=client.8434 2023-11-08T16:36:42.818 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock remove test1 id client.8434 2023-11-08T16:36:43.451 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:43.451 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:36:43.452 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:36:43.508 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:36:43.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id --shared tag 2023-11-08T16:36:43.582 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:43.582 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 1 ' 2023-11-08T16:36:43.635 INFO:tasks.workunit.client.0.smithi196.stdout:There is 1 shared lock on this image. 2023-11-08T16:36:43.635 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id --shared tag 2023-11-08T16:36:43.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:43.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 2 ' 2023-11-08T16:36:43.757 INFO:tasks.workunit.client.0.smithi196.stdout:There are 2 shared locks on this image. 2023-11-08T16:36:43.758 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock add test1 id2 --shared tag 2023-11-08T16:36:43.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:43.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep ' 3 ' 2023-11-08T16:36:43.881 INFO:tasks.workunit.client.0.smithi196.stdout:There are 3 shared locks on this image. 2023-11-08T16:36:43.882 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:43.882 INFO:tasks.workunit.client.0.smithi196.stderr:+ tail -n 1 2023-11-08T16:36:43.882 INFO:tasks.workunit.client.0.smithi196.stderr:+ awk '{print $2, $1;}' 2023-11-08T16:36:43.883 INFO:tasks.workunit.client.0.smithi196.stderr:+ xargs rbd lock remove test1 2023-11-08T16:36:44.457 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info test1 2023-11-08T16:36:44.457 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -qE 'features:.*exclusive' 2023-11-08T16:36:44.511 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd lock list test1 2023-11-08T16:36:44.563 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' -n 'There are 2 shared locks on this image. 2023-11-08T16:36:44.564 INFO:tasks.workunit.client.0.smithi196.stderr:Lock tag: tag 2023-11-08T16:36:44.564 INFO:tasks.workunit.client.0.smithi196.stderr:Locker ID Address 2023-11-08T16:36:44.564 INFO:tasks.workunit.client.0.smithi196.stderr:client.8449 id 172.21.15.196:0/141759483 2023-11-08T16:36:44.564 INFO:tasks.workunit.client.0.smithi196.stderr:client.8455 id 172.21.15.196:0/4035612803' ']' 2023-11-08T16:36:44.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ tail -n 1 2023-11-08T16:36:44.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ awk '{print $2, $1;}' 2023-11-08T16:36:44.566 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:44.566 INFO:tasks.workunit.client.0.smithi196.stderr:+ xargs rbd lock remove test1 2023-11-08T16:36:45.356 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd lock list test1 2023-11-08T16:36:45.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' -n 'There is 1 shared lock on this image. 2023-11-08T16:36:45.414 INFO:tasks.workunit.client.0.smithi196.stderr:Lock tag: tag 2023-11-08T16:36:45.414 INFO:tasks.workunit.client.0.smithi196.stderr:Locker ID Address 2023-11-08T16:36:45.414 INFO:tasks.workunit.client.0.smithi196.stderr:client.8449 id 172.21.15.196:0/141759483' ']' 2023-11-08T16:36:45.415 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd lock list test1 2023-11-08T16:36:45.415 INFO:tasks.workunit.client.0.smithi196.stderr:+ tail -n 1 2023-11-08T16:36:45.415 INFO:tasks.workunit.client.0.smithi196.stderr:+ xargs rbd lock remove test1 2023-11-08T16:36:45.416 INFO:tasks.workunit.client.0.smithi196.stderr:+ awk '{print $2, $1;}' 2023-11-08T16:36:46.468 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd lock list test1 2023-11-08T16:36:46.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' -n '' ']' 2023-11-08T16:36:46.736 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:36:46.933 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:46.928+0000 7fa6f6f92700 0 -- 172.21.15.196:0/4269840201 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55b9a8ca0260 msgr2=0x55b9a8ca2650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:36:46.937 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:46.942 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_clone 2023-11-08T16:36:46.943 INFO:tasks.workunit.client.0.smithi196.stdout:testing clone... 2023-11-08T16:36:46.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing clone...' 2023-11-08T16:36:46.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:46.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.064 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.196 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.328 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.451 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.574 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.837 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:47.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.103 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.236 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.365 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.631 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.760 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:48.888 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:49.015 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:49.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:49.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create test1 --image-format 2 -s 1 2023-11-08T16:36:49.354 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@s1 2023-11-08T16:36:49.481 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:36:49.495 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect test1@s1 2023-11-08T16:36:49.559 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool create rbd2 8 2023-11-08T16:36:50.569 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' already exists 2023-11-08T16:36:50.577 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd pool init rbd2 2023-11-08T16:36:53.506 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test1@s1 rbd2/clone 2023-11-08T16:36:53.606 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls 2023-11-08T16:36:53.606 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep clone 2023-11-08T16:36:53.647 INFO:tasks.workunit.client.0.smithi196.stdout:clone 2023-11-08T16:36:53.648 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls -l 2023-11-08T16:36:53.648 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep clone 2023-11-08T16:36:53.649 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1@s1 2023-11-08T16:36:53.722 INFO:tasks.workunit.client.0.smithi196.stdout:clone 1 MiB rbd/test1@s1 2 2023-11-08T16:36:53.722 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:36:53.723 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v clone 2023-11-08T16:36:53.764 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:36:53.764 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd flatten rbd2/clone 2023-11-08T16:36:53.840 INFO:tasks.workunit.client.0.smithi196.stderr: Image flatten: 100% complete...done. 2023-11-08T16:36:53.853 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create rbd2/clone@s1 2023-11-08T16:36:54.524 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:36:54.536 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect rbd2/clone@s1 2023-11-08T16:36:54.599 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-11-08T16:36:54.719 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:36:54.720 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep clone2 2023-11-08T16:36:54.762 INFO:tasks.workunit.client.0.smithi196.stdout:clone2 2023-11-08T16:36:54.762 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:36:54.763 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep clone2 2023-11-08T16:36:54.763 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep rbd2/clone@s1 2023-11-08T16:36:54.838 INFO:tasks.workunit.client.0.smithi196.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-11-08T16:36:54.839 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd -p rbd2 ls 2023-11-08T16:36:54.839 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v clone2 2023-11-08T16:36:54.876 INFO:tasks.workunit.client.0.smithi196.stdout:clone 2023-11-08T16:36:54.877 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm clone2 2023-11-08T16:36:55.090 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:55.084+0000 7f99a3fd1700 0 -- 172.21.15.196:0/1094542394 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f9984034670 msgr2=0x7f9984036aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:36:55.094 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:55.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-11-08T16:36:55.158 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm rbd2/clone@s1 2023-11-08T16:36:55.520 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:36:55.530 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm rbd2/clone 2023-11-08T16:36:55.686 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:36:55.680+0000 7f88cb10a700 0 -- 172.21.15.196:0/2181388835 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x562e3bd39310 msgr2=0x562e3bdde270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:36:55.687 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:55.692 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect test1@s1 2023-11-08T16:36:55.763 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm test1@s1 2023-11-08T16:36:56.541 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:36:56.553 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:36:56.744 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:36:56.748 INFO:tasks.workunit.client.0.smithi196.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-11-08T16:36:57.630 INFO:tasks.workunit.client.0.smithi196.stderr:pool 'rbd2' does not exist 2023-11-08T16:36:57.638 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_trash 2023-11-08T16:36:57.638 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing trash...' 2023-11-08T16:36:57.639 INFO:tasks.workunit.client.0.smithi196.stdout:testing trash... 2023-11-08T16:36:57.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:36:57.639 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:57.764 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:57.893 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.020 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.353 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.478 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.615 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.745 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:58.872 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.002 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.126 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.464 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.725 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.857 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:36:59.977 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:00.109 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:00.239 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:00.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:37:00.446 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test2 2023-11-08T16:37:00.514 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:00.515 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:37:00.546 INFO:tasks.workunit.client.0.smithi196.stdout:test1 2023-11-08T16:37:00.547 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:00.547 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:37:00.583 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:37:00.584 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:00.584 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:00.585 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:00.622 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:00.623 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:37:00.623 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*2.*' 2023-11-08T16:37:00.684 INFO:tasks.workunit.client.0.smithi196.stdout:test1 1 MiB 2 2023-11-08T16:37:00.685 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:37:00.686 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*2.*' 2023-11-08T16:37:00.741 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 2 2023-11-08T16:37:00.741 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv test1 2023-11-08T16:37:00.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:00.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:37:00.891 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:37:00.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:00.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:00.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:00.935 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:00.935 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:37:00.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*2.*' 2023-11-08T16:37:00.989 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 2 2023-11-08T16:37:00.990 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:00.990 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:37:01.030 INFO:tasks.workunit.client.0.smithi196.stdout:2255b6b23515 test1 2023-11-08T16:37:01.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:01.031 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:01.032 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:01.070 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:01.070 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:01.071 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*USER.*' 2023-11-08T16:37:01.125 INFO:tasks.workunit.client.0.smithi196.stdout:2255b6b23515 test1 USER Wed Nov 8 16:37:00 2023 expired at Wed Nov 8 16:37:00 2023 2023-11-08T16:37:01.126 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:01.127 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v 'protected until' 2023-11-08T16:37:01.185 INFO:tasks.workunit.client.0.smithi196.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-11-08T16:37:01.185 INFO:tasks.workunit.client.0.smithi196.stdout:2255b6b23515 test1 USER Wed Nov 8 16:37:00 2023 expired at Wed Nov 8 16:37:00 2023 2023-11-08T16:37:01.186 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:01.187 INFO:tasks.workunit.client.0.smithi196.stderr:++ cut -d ' ' -f 1 2023-11-08T16:37:01.229 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=2255b6b23515 2023-11-08T16:37:01.230 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm 2255b6b23515 2023-11-08T16:37:01.330 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:01.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv test2 2023-11-08T16:37:01.435 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:01.436 INFO:tasks.workunit.client.0.smithi196.stderr:++ cut -d ' ' -f 1 2023-11-08T16:37:01.475 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=225840830304 2023-11-08T16:37:01.476 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info --image-id 225840830304 2023-11-08T16:37:01.476 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'rbd image '\''test2'\''' 2023-11-08T16:37:01.527 INFO:tasks.workunit.client.0.smithi196.stdout:rbd image 'test2': 2023-11-08T16:37:01.527 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash restore 225840830304 2023-11-08T16:37:01.588 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:01.589 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:37:01.630 INFO:tasks.workunit.client.0.smithi196.stdout:test2 2023-11-08T16:37:01.630 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:37:01.631 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:01.631 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:01.674 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:01.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls -l 2023-11-08T16:37:01.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*2.*' 2023-11-08T16:37:01.731 INFO:tasks.workunit.client.0.smithi196.stdout:test2 1 MiB 2 2023-11-08T16:37:01.732 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-11-08T16:37:01.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:01.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test2 2023-11-08T16:37:01.872 INFO:tasks.workunit.client.0.smithi196.stdout:225840830304 test2 2023-11-08T16:37:01.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:01.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:01.873 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:01.911 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:01.911 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:01.912 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test2.*USER.*protected until' 2023-11-08T16:37:01.969 INFO:tasks.workunit.client.0.smithi196.stdout:225840830304 test2 USER Wed Nov 8 16:37:01 2023 protected until Wed Nov 8 17:37:01 2023 2023-11-08T16:37:01.970 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm 225840830304 2023-11-08T16:37:01.970 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'Deferment time has not expired' 2023-11-08T16:37:02.009 INFO:tasks.workunit.client.0.smithi196.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-11-08T16:37:02.010 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm --image-id 225840830304 --force 2023-11-08T16:37:02.118 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:02.122 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:37:02.196 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@snap1 2023-11-08T16:37:02.369 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:02.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect test1@snap1 2023-11-08T16:37:02.455 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv test1 2023-11-08T16:37:02.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:02.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:37:02.602 INFO:tasks.workunit.client.0.smithi196.stdout:22afdf6e9c8b test1 2023-11-08T16:37:02.603 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:02.604 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:02.604 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:02.640 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:02.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:02.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*USER.*' 2023-11-08T16:37:02.702 INFO:tasks.workunit.client.0.smithi196.stdout:22afdf6e9c8b test1 USER Wed Nov 8 16:37:02 2023 expired at Wed Nov 8 16:37:02 2023 2023-11-08T16:37:02.702 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:02.703 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v 'protected until' 2023-11-08T16:37:02.760 INFO:tasks.workunit.client.0.smithi196.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-11-08T16:37:02.760 INFO:tasks.workunit.client.0.smithi196.stdout:22afdf6e9c8b test1 USER Wed Nov 8 16:37:02 2023 expired at Wed Nov 8 16:37:02 2023 2023-11-08T16:37:02.761 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:02.761 INFO:tasks.workunit.client.0.smithi196.stderr:++ cut -d ' ' -f 1 2023-11-08T16:37:02.799 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=22afdf6e9c8b 2023-11-08T16:37:02.800 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls --image-id 22afdf6e9c8b 2023-11-08T16:37:02.801 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:37:02.801 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:02.802 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:02.861 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:02.863 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls --image-id 22afdf6e9c8b 2023-11-08T16:37:02.863 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '.*snap1.*' 2023-11-08T16:37:02.923 INFO:tasks.workunit.client.0.smithi196.stdout: 34 snap1 1 MiB yes Wed Nov 8 16:37:02 2023 2023-11-08T16:37:02.923 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect --image-id 22afdf6e9c8b --snap snap1 2023-11-08T16:37:03.003 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm --image-id 22afdf6e9c8b --snap snap1 2023-11-08T16:37:03.365 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:03.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls --image-id 22afdf6e9c8b 2023-11-08T16:37:03.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:37:03.388 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:03.389 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:03.437 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:03.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash restore 22afdf6e9c8b 2023-11-08T16:37:03.495 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@snap1 2023-11-08T16:37:04.383 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:04.397 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@snap2 2023-11-08T16:37:05.369 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:05.384 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls --image-id 22afdf6e9c8b 2023-11-08T16:37:05.384 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:37:05.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:05.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:05.437 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:05.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 22afdf6e9c8b 2023-11-08T16:37:07.387 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:07.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls --image-id 22afdf6e9c8b 2023-11-08T16:37:07.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:37:07.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:07.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:07.472 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:07.473 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-11-08T16:37:07.581 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:07.586 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:07.587 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:37:07.626 INFO:tasks.workunit.client.0.smithi196.stdout:22afdf6e9c8b test1 2023-11-08T16:37:07.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:07.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:07.628 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:07.667 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:07.668 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -l 2023-11-08T16:37:07.668 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'test1.*USER.*protected until' 2023-11-08T16:37:07.726 INFO:tasks.workunit.client.0.smithi196.stdout:22afdf6e9c8b test1 USER Wed Nov 8 16:37:07 2023 protected until Wed Nov 8 17:37:07 2023 2023-11-08T16:37:07.727 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm 22afdf6e9c8b 2023-11-08T16:37:07.727 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'Deferment time has not expired' 2023-11-08T16:37:07.767 INFO:tasks.workunit.client.0.smithi196.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-11-08T16:37:07.767 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash rm --image-id 22afdf6e9c8b --force 2023-11-08T16:37:07.876 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:07.881 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:37:07.881 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.015 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.141 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.271 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.402 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.536 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.666 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.804 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:08.938 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.066 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.195 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.320 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.435 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.699 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.824 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:09.955 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.085 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.211 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_purge 2023-11-08T16:37:10.211 INFO:tasks.workunit.client.0.smithi196.stdout:testing trash purge... 2023-11-08T16:37:10.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing trash purge...' 2023-11-08T16:37:10.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:37:10.212 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.346 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.486 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.748 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.874 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:10.999 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.126 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.257 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.386 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.517 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.644 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.774 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:11.902 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:12.032 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:12.162 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:12.290 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:12.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:12.549 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:12.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:12.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:12.592 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:12.592 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:12.629 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete...done. 2023-11-08T16:37:12.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:12.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-11-08T16:37:12.772 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:12.882 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:12.982 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:12.982 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:12.982 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:13.019 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:13.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:13.196 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:13.201 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:13.201 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:13.201 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:13.238 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:13.238 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:13.309 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-11-08T16:37:13.373 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-11-08T16:37:13.479 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-11-08T16:37:13.583 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:13.584 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:13.584 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:13.620 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:13.620 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:13.653 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete...done. 2023-11-08T16:37:13.657 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:13.657 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:13.658 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:13.691 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:13.692 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-11-08T16:37:13.813 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:13.818 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:13.819 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:13.819 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:13.853 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:13.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:13.854 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:13.892 INFO:tasks.workunit.client.0.smithi196.stdout:23f3e0070139 testimg2 2023-11-08T16:37:13.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-11-08T16:37:14.017 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:14.022 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:14.022 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:14.022 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:14.061 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:14.062 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:14.132 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1@snap 2023-11-08T16:37:14.265 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:14.280 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-11-08T16:37:14.348 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:14.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:14.507 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:14.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:14.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:14.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:14.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:14.753 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:14.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:14.754 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:15.050 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:15.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:15.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:15.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:15.089 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:15.090 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:15.090 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:15.126 INFO:tasks.workunit.client.0.smithi196.stdout:2414814cc5b3 testimg1 2023-11-08T16:37:15.127 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:15.127 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{ print $1 }' 2023-11-08T16:37:15.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=2414814cc5b3 2023-11-08T16:37:15.371 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 2414814cc5b3 2023-11-08T16:37:16.367 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:16.385 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:16.492 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:16.497 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:16.497 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:16.497 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:16.541 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:16.541 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:16.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-11-08T16:37:16.681 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap 2023-11-08T16:37:17.388 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:17.405 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:17.478 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:17.579 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:17.688 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:18.003 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:18.004 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:18.004 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:18.043 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:18.044 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:18.044 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:18.321 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:18.322 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:18.322 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:18.323 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:18.358 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:18.359 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:18.359 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:18.395 INFO:tasks.workunit.client.0.smithi196.stdout:2444cccf556c testimg2 2023-11-08T16:37:18.397 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:18.397 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{ print $1 }' 2023-11-08T16:37:18.438 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=2444cccf556c 2023-11-08T16:37:18.439 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 2444cccf556c 2023-11-08T16:37:19.388 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:19.408 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:19.511 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:19.515 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:19.516 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:19.516 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:19.549 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:19.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:19.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-11-08T16:37:19.680 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:19.740 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg3@snap 2023-11-08T16:37:20.370 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:20.384 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:20.486 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:20.595 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:20.700 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:20.700 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:20.701 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:20.741 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:20.742 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:20.742 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:21.025 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:21.026 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:21.027 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:21.027 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:21.066 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:21.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:21.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg3 2023-11-08T16:37:21.106 INFO:tasks.workunit.client.0.smithi196.stdout:24742f1d2412 testimg3 2023-11-08T16:37:21.107 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:21.107 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{ print $1 }' 2023-11-08T16:37:21.147 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=24742f1d2412 2023-11-08T16:37:21.148 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 24742f1d2412 2023-11-08T16:37:21.390 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:21.405 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:21.515 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:21.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:21.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:21.520 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:21.556 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:21.557 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:21.626 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1@snap 2023-11-08T16:37:22.409 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:22.425 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-11-08T16:37:22.540 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg1@snap 2023-11-08T16:37:22.610 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:22.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:22.694 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap 2023-11-08T16:37:23.413 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:23.428 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-11-08T16:37:23.550 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-11-08T16:37:23.681 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg2@snap 2023-11-08T16:37:23.760 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:23.778 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg4@snap 2023-11-08T16:37:24.427 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:24.443 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-11-08T16:37:24.590 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg4@snap 2023-11-08T16:37:24.687 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:24.704 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:24.820 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:24.933 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:25.057 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg4 2023-11-08T16:37:25.159 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.159 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:25.160 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:25.197 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:25.197 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:25.198 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:25.632 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:25.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:25.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:25.668 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:25.669 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.670 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:25.710 INFO:tasks.workunit.client.0.smithi196.stdout:249b488674c7 testimg1 2023-11-08T16:37:25.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.711 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:25.748 INFO:tasks.workunit.client.0.smithi196.stdout:24a1b57f13aa testimg2 2023-11-08T16:37:25.749 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg4 2023-11-08T16:37:25.749 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.791 INFO:tasks.workunit.client.0.smithi196.stdout:24addd717cbf testimg4 2023-11-08T16:37:25.792 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg6 2023-11-08T16:37:25.895 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:25.896 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:25.896 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:25.933 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:25.934 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:25.934 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:26.749 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:26.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:26.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:26.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:26.788 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:26.789 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:26.789 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:26.830 INFO:tasks.workunit.client.0.smithi196.stdout:249b488674c7 testimg1 2023-11-08T16:37:26.830 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:26.830 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:26.870 INFO:tasks.workunit.client.0.smithi196.stdout:24a1b57f13aa testimg2 2023-11-08T16:37:26.870 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg5 2023-11-08T16:37:26.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:26.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:26.979 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:27.018 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:27.018 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:27.206 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:37:27.199+0000 7f3daedc0700 0 -- 172.21.15.196:0/1565478345 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x557d0c488890 msgr2=0x557d0c49a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:37:27.235 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:37:27.231+0000 7f3dae5bf700 0 -- 172.21.15.196:0/1565478345 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f3d8804f8c0 msgr2=0x7f3d88051cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:37:28.562 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:28.567 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:28.567 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:28.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:28.606 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:28.607 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:28.675 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1@snap 2023-11-08T16:37:29.447 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:29.461 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-11-08T16:37:29.573 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg1@snap 2023-11-08T16:37:29.645 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:29.661 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:29.731 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg3@snap 2023-11-08T16:37:30.380 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:30.396 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap 2023-11-08T16:37:31.468 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:31.487 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-11-08T16:37:31.614 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-11-08T16:37:31.741 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg2@snap 2023-11-08T16:37:31.825 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:31.841 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg4@snap 2023-11-08T16:37:32.468 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:32.483 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-11-08T16:37:32.640 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg4@snap 2023-11-08T16:37:32.738 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:32.756 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg1 2023-11-08T16:37:32.862 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg2 2023-11-08T16:37:32.963 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:33.077 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg4 2023-11-08T16:37:33.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:33.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:33.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:33.226 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:33.227 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:33.227 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:33.467 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:33.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:33.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:33.468 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:33.506 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:33.507 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg6 2023-11-08T16:37:33.620 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:33.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:33.621 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 5 2023-11-08T16:37:33.661 INFO:tasks.workunit.client.0.smithi196.stdout:5 2023-11-08T16:37:33.661 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:33.662 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:34.897 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:34.897 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:34.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:34.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:34.935 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:34.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:34.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:34.975 INFO:tasks.workunit.client.0.smithi196.stdout:24fa2b53f08b testimg1 2023-11-08T16:37:34.976 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:34.976 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:35.018 INFO:tasks.workunit.client.0.smithi196.stdout:2500c30c23e9 testimg2 2023-11-08T16:37:35.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:35.019 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg3 2023-11-08T16:37:35.058 INFO:tasks.workunit.client.0.smithi196.stdout:250648e9d982 testimg3 2023-11-08T16:37:35.058 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg5 2023-11-08T16:37:35.167 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:35.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:35.168 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:35.206 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:35.207 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:35.207 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:37.741 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:37.742 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:37.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:37.743 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:37.780 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:37.781 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:37.781 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg3 2023-11-08T16:37:37.823 INFO:tasks.workunit.client.0.smithi196.stdout:250648e9d982 testimg3 2023-11-08T16:37:37.824 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:37.824 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{ print $1 }' 2023-11-08T16:37:37.869 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=250648e9d982 2023-11-08T16:37:37.870 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 250648e9d982 2023-11-08T16:37:38.493 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:38.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:38.611 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:38.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:38.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:38.617 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:38.657 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:38.657 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:38.725 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1@snap 2023-11-08T16:37:39.508 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:39.524 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-11-08T16:37:39.653 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg1@snap 2023-11-08T16:37:39.720 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:39.735 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:39.804 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap 2023-11-08T16:37:40.386 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:40.401 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-11-08T16:37:40.539 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-11-08T16:37:40.660 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg2@snap 2023-11-08T16:37:40.752 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:40.769 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg4@snap 2023-11-08T16:37:41.510 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:41.527 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-11-08T16:37:41.664 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg4@snap 2023-11-08T16:37:41.762 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:41.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-11-08T16:37:41.917 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:41.921 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-11-08T16:37:42.058 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:42.061 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:42.177 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-11-08T16:37:42.320 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:42.324 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:42.324 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:42.325 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:42.362 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:42.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:42.363 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:42.797 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:42.798 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:42.798 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:42.799 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:42.837 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:42.837 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:42.838 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:42.876 INFO:tasks.workunit.client.0.smithi196.stdout:25669dbb28c7 testimg1 2023-11-08T16:37:42.877 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:42.877 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:42.916 INFO:tasks.workunit.client.0.smithi196.stdout:256c933d88b0 testimg2 2023-11-08T16:37:42.917 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:42.917 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg4 2023-11-08T16:37:42.952 INFO:tasks.workunit.client.0.smithi196.stdout:2578fac1ff60 testimg4 2023-11-08T16:37:42.953 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg6 2023-11-08T16:37:43.066 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:43.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:43.067 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:43.106 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:43.107 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:43.107 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:43.709 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:43.709 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:43.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:43.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 2 2023-11-08T16:37:43.751 INFO:tasks.workunit.client.0.smithi196.stdout:2 2023-11-08T16:37:43.751 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:43.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:43.789 INFO:tasks.workunit.client.0.smithi196.stdout:25669dbb28c7 testimg1 2023-11-08T16:37:43.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:43.791 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:43.830 INFO:tasks.workunit.client.0.smithi196.stdout:256c933d88b0 testimg2 2023-11-08T16:37:43.830 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg5 2023-11-08T16:37:44.147 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:44.147 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:44.147 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:44.187 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:44.187 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:44.365 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:37:44.359+0000 7f5a5c209700 0 -- 172.21.15.196:0/3982161065 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f5a3404f8c0 msgr2=0x7f5a34051cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:37:44.386 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:37:44.383+0000 7f5a5c209700 0 -- 172.21.15.196:0/3982161065 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x561aaf6240e0 msgr2=0x7f5a3c039330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:37:45.486 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:45.492 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:45.492 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:45.493 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:45.532 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:45.533 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-11-08T16:37:45.603 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1@snap 2023-11-08T16:37:46.533 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:46.548 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-11-08T16:37:46.657 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg1@snap 2023-11-08T16:37:46.732 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:46.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-11-08T16:37:46.817 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg3@snap 2023-11-08T16:37:47.544 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:47.561 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap 2023-11-08T16:37:48.559 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:48.577 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-11-08T16:37:48.712 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-11-08T16:37:48.833 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg2@snap 2023-11-08T16:37:48.922 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:48.939 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg4@snap 2023-11-08T16:37:49.559 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:49.574 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-11-08T16:37:49.723 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm testimg4@snap 2023-11-08T16:37:49.815 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:37:49.830 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-11-08T16:37:50.628 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:50.632 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-11-08T16:37:50.775 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:50.779 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg3 2023-11-08T16:37:50.887 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-11-08T16:37:51.030 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:37:51.036 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:51.036 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:51.037 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:51.076 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:51.077 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:51.077 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:51.325 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:51.326 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:51.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:51.327 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:51.366 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:51.367 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg6 2023-11-08T16:37:51.469 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:51.470 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:51.470 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 5 2023-11-08T16:37:51.509 INFO:tasks.workunit.client.0.smithi196.stdout:5 2023-11-08T16:37:51.510 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:51.510 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:52.625 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:52.626 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:52.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:52.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 3 2023-11-08T16:37:52.663 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:37:52.664 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:52.665 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg1 2023-11-08T16:37:52.705 INFO:tasks.workunit.client.0.smithi196.stdout:25c635ac4f54 testimg1 2023-11-08T16:37:52.705 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:52.706 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg2 2023-11-08T16:37:52.945 INFO:tasks.workunit.client.0.smithi196.stdout:25cc93a2a2a7 testimg2 2023-11-08T16:37:52.946 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:52.946 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg3 2023-11-08T16:37:52.989 INFO:tasks.workunit.client.0.smithi196.stdout:25d2b4c0f910 testimg3 2023-11-08T16:37:52.989 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash mv testimg5 2023-11-08T16:37:53.094 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:53.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:53.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 4 2023-11-08T16:37:53.133 INFO:tasks.workunit.client.0.smithi196.stdout:4 2023-11-08T16:37:53.134 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:53.134 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'some expired images could not be removed' 2023-11-08T16:37:55.565 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: some expired images could not be removed 2023-11-08T16:37:55.565 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:55.566 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:55.566 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:37:55.606 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:37:55.607 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:55.607 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep testimg3 2023-11-08T16:37:55.648 INFO:tasks.workunit.client.0.smithi196.stdout:25d2b4c0f910 testimg3 2023-11-08T16:37:55.649 INFO:tasks.workunit.client.0.smithi196.stderr:++ rbd trash ls 2023-11-08T16:37:55.649 INFO:tasks.workunit.client.0.smithi196.stderr:++ awk '{ print $1 }' 2023-11-08T16:37:55.691 INFO:tasks.workunit.client.0.smithi196.stderr:+ ID=25d2b4c0f910 2023-11-08T16:37:55.692 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge --image-id 25d2b4c0f910 2023-11-08T16:37:56.400 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:37:56.418 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash purge 2023-11-08T16:37:56.524 INFO:tasks.workunit.client.0.smithi196.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-11-08T16:37:56.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls 2023-11-08T16:37:56.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:37:56.529 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 0 2023-11-08T16:37:56.568 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:37:56.569 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_deep_copy_clone 2023-11-08T16:37:56.569 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing deep copy clone...' 2023-11-08T16:37:56.569 INFO:tasks.workunit.client.0.smithi196.stdout:testing deep copy clone... 2023-11-08T16:37:56.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:37:56.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:56.695 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:56.830 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:56.967 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.098 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.230 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.368 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.508 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.774 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:57.908 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.046 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.184 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.318 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.460 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.594 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.727 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:58.875 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:37:59.010 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-11-08T16:37:59.081 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg1 --snap=snap1 2023-11-08T16:37:59.468 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:37:59.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect testimg1@snap1 2023-11-08T16:37:59.559 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone testimg1@snap1 testimg2 2023-11-08T16:37:59.680 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap2 2023-11-08T16:38:00.394 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:00.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy testimg2 testimg3 2023-11-08T16:38:01.457 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:01.451+0000 7f32b7643700 0 -- 172.21.15.196:0/3655355659 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x563a5bc8cf80 msgr2=0x563a5bd75320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:01.491 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:38:01.497 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:38:01.497 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:38:01.567 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:38:01.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:38:01.568 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-11-08T16:38:01.640 INFO:tasks.workunit.client.0.smithi196.stdout: parent: rbd/testimg1@snap1 2023-11-08T16:38:01.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg3 2023-11-08T16:38:01.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:38:01.641 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:01.642 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:38:01.710 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:38:01.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg3 2023-11-08T16:38:01.711 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '.*snap2.*' 2023-11-08T16:38:01.779 INFO:tasks.workunit.client.0.smithi196.stdout: 76 snap2 256 MiB Wed Nov 8 16:38:01 2023 2023-11-08T16:38:01.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg2 2023-11-08T16:38:01.780 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'features:.*deep-flatten' 2023-11-08T16:38:01.848 INFO:tasks.workunit.client.0.smithi196.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-11-08T16:38:01.849 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:38:01.849 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'features:.*deep-flatten' 2023-11-08T16:38:01.924 INFO:tasks.workunit.client.0.smithi196.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-11-08T16:38:01.925 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd flatten testimg2 2023-11-08T16:38:02.019 INFO:tasks.workunit.client.0.smithi196.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-11-08T16:38:02.037 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd flatten testimg3 2023-11-08T16:38:02.126 INFO:tasks.workunit.client.0.smithi196.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-11-08T16:38:02.144 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect testimg1@snap1 2023-11-08T16:38:02.217 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge testimg2 2023-11-08T16:38:02.461 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:38:02.483 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap purge testimg3 2023-11-08T16:38:03.477 INFO:tasks.workunit.client.0.smithi196.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-11-08T16:38:03.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg2 2023-11-08T16:38:03.924 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-11-08T16:38:03.918+0000 7fcb317dc700 0 -- 172.21.15.196:0/3191580210 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fcb100061b0 msgr2=0x7fcb100085a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:03.925 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:03.928 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm testimg3 2023-11-08T16:38:04.346 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-11-08T16:38:04.338+0000 7f8e7a575700 0 -- 172.21.15.196:0/4040612004 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x56114f751f10 msgr2=0x56114f802e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:04.352 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:04.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect testimg1@snap1 2023-11-08T16:38:04.424 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone testimg1@snap1 testimg2 2023-11-08T16:38:04.554 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create testimg2@snap2 2023-11-08T16:38:05.490 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:05.506 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-11-08T16:38:06.620 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:06.614+0000 7efd0482a700 0 -- 172.21.15.196:0/2451043666 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x5556d55f02d0 msgr2=0x5556d56dce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:06.725 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete...2023-11-08T16:38:06.718+0000 7efd04029700 0 -- 172.21.15.196:0/2451043666 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x5556d55f02d0 msgr2=0x7efce4039580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:07.564 INFO:tasks.workunit.client.0.smithi196.stderr: Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-11-08T16:38:07.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:38:07.570 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'size 256 MiB' 2023-11-08T16:38:07.633 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:38:07.634 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg3 2023-11-08T16:38:07.634 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v parent: 2023-11-08T16:38:07.688 INFO:tasks.workunit.client.0.smithi196.stdout:rbd image 'testimg3': 2023-11-08T16:38:07.688 INFO:tasks.workunit.client.0.smithi196.stdout: size 256 MiB in 64 objects 2023-11-08T16:38:07.688 INFO:tasks.workunit.client.0.smithi196.stdout: order 22 (4 MiB objects) 2023-11-08T16:38:07.688 INFO:tasks.workunit.client.0.smithi196.stdout: snapshot_count: 1 2023-11-08T16:38:07.689 INFO:tasks.workunit.client.0.smithi196.stdout: id: 26dfa92f0e6e 2023-11-08T16:38:07.689 INFO:tasks.workunit.client.0.smithi196.stdout: block_name_prefix: rbd_data.26dfa92f0e6e 2023-11-08T16:38:07.689 INFO:tasks.workunit.client.0.smithi196.stdout: format: 2 2023-11-08T16:38:07.689 INFO:tasks.workunit.client.0.smithi196.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-11-08T16:38:07.689 INFO:tasks.workunit.client.0.smithi196.stdout: op_features: 2023-11-08T16:38:07.690 INFO:tasks.workunit.client.0.smithi196.stdout: flags: 2023-11-08T16:38:07.690 INFO:tasks.workunit.client.0.smithi196.stdout: create_timestamp: Wed Nov 8 16:38:05 2023 2023-11-08T16:38:07.690 INFO:tasks.workunit.client.0.smithi196.stdout: access_timestamp: Wed Nov 8 16:38:05 2023 2023-11-08T16:38:07.690 INFO:tasks.workunit.client.0.smithi196.stdout: modify_timestamp: Wed Nov 8 16:38:05 2023 2023-11-08T16:38:07.691 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg3 2023-11-08T16:38:07.691 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -v SNAPID 2023-11-08T16:38:07.691 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:07.692 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 1 2023-11-08T16:38:07.743 INFO:tasks.workunit.client.0.smithi196.stdout:1 2023-11-08T16:38:07.744 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap ls testimg3 2023-11-08T16:38:07.744 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '.*snap2.*' 2023-11-08T16:38:07.796 INFO:tasks.workunit.client.0.smithi196.stdout: 80 snap2 256 MiB Wed Nov 8 16:38:06 2023 2023-11-08T16:38:07.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd info testimg2 2023-11-08T16:38:07.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'features:.*deep-flatten' 2023-11-08T16:38:07.871 INFO:tasks.workunit.client.0.smithi196.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-11-08T16:38:07.872 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd flatten testimg2 2023-11-08T16:38:07.959 INFO:tasks.workunit.client.0.smithi196.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-11-08T16:38:07.977 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect testimg1@snap1 2023-11-08T16:38:08.050 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:38:08.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:08.748 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:09.750 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:10.710 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:10.832 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:10.973 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.099 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.232 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.360 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.498 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:11.971 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.099 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.233 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.366 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.501 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.624 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:12.964 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.094 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_clone_v2 2023-11-08T16:38:13.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing clone v2...' 2023-11-08T16:38:13.095 INFO:tasks.workunit.client.0.smithi196.stdout:testing clone v2... 2023-11-08T16:38:13.095 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:38:13.096 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.230 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.369 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.646 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:13.990 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.122 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.259 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.394 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.533 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.670 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.803 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:14.936 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.079 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.353 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.496 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.629 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:15.768 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:38:15.848 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@1 2023-11-08T16:38:16.409 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:16.425 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-11-08T16:38:16.484 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:16.478+0000 7f544ffff700 -1 librbd::image::CloneRequest: 0x5591d424b8f0 validate_parent: parent snapshot must be protected 2023-11-08T16:38:16.485 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: clone error: (22) Invalid argument 2023-11-08T16:38:16.489 INFO:tasks.workunit.client.0.smithi196.stderr:+ true 2023-11-08T16:38:16.489 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-11-08T16:38:16.612 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-11-08T16:38:16.734 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap protect test1@1 2023-11-08T16:38:16.799 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-11-08T16:38:16.932 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd children test1@1 2023-11-08T16:38:16.932 INFO:tasks.workunit.client.0.smithi196.stderr:+ sort 2023-11-08T16:38:16.933 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr '\n' ' ' 2023-11-08T16:38:16.933 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -E 'test2.*test3.*test4' 2023-11-08T16:38:17.006 INFO:tasks.workunit.client.0.smithi196.stdout:rbd/test2 rbd/test3 rbd/test4 2023-11-08T16:38:17.007 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd children --descendants test1 2023-11-08T16:38:17.007 INFO:tasks.workunit.client.0.smithi196.stderr:+ sort 2023-11-08T16:38:17.008 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr '\n' ' ' 2023-11-08T16:38:17.008 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -E 'test2.*test3.*test4' 2023-11-08T16:38:17.109 INFO:tasks.workunit.client.0.smithi196.stdout:rbd/test2 rbd/test3 rbd/test4 2023-11-08T16:38:17.110 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd remove test4 2023-11-08T16:38:17.329 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:17.334 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap unprotect test1@1 2023-11-08T16:38:17.408 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap remove test1@1 2023-11-08T16:38:17.479 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:38:17.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap list --all test1 2023-11-08T16:38:17.499 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep -E 'trash \(1\) *$' 2023-11-08T16:38:17.554 INFO:tasks.workunit.client.0.smithi196.stdout: 84 ea8d3a4b-5818-469f-9905-57d579498190 1 MiB Wed Nov 8 16:38:16 2023 trash (1) 2023-11-08T16:38:17.554 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@2 2023-11-08T16:38:18.421 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:18.439 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:18.439 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'image has snapshots' 2023-11-08T16:38:18.535 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-11-08T16:38:18.535 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm test1@2 2023-11-08T16:38:19.410 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:38:19.423 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:19.424 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'linked clones' 2023-11-08T16:38:19.518 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-11-08T16:38:19.519 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test3 2023-11-08T16:38:19.711 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:19.706+0000 7fa74aae3700 0 -- 172.21.15.196:0/1040908634 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55c56d126e20 msgr2=0x55c56d1e4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:19.721 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:19.726 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:19.726 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep 'linked clones' 2023-11-08T16:38:19.826 INFO:tasks.workunit.client.0.smithi196.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-11-08T16:38:19.826 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd flatten test2 2023-11-08T16:38:20.427 INFO:tasks.workunit.client.0.smithi196.stderr: Image flatten: 100% complete...done. 2023-11-08T16:38:20.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap list --all test1 2023-11-08T16:38:20.444 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:20.445 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:38:20.494 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:38:20.494 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:20.702 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:20.707 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:38:20.922 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:20.927 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 -s 1 test1 2023-11-08T16:38:20.999 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@1 2023-11-08T16:38:21.435 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:21.451 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap create test1@2 2023-11-08T16:38:22.441 INFO:tasks.workunit.client.0.smithi196.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-11-08T16:38:22.458 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-11-08T16:38:22.588 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-11-08T16:38:22.715 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm test1@1 2023-11-08T16:38:22.789 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:38:22.806 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd snap rm test1@2 2023-11-08T16:38:22.880 INFO:tasks.workunit.client.0.smithi196.stderr: Removing snap: 100% complete...done. 2023-11-08T16:38:22.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd rm test1 2023-11-08T16:38:22.898 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:22.994 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:22.986+0000 7f4b61772340 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-11-08T16:38:22.994 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 0% complete...failed. 2023-11-08T16:38:23.007 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-11-08T16:38:23.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:38:23.012 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-11-08T16:38:23.166 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:23.172 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -a 2023-11-08T16:38:23.172 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:23.214 INFO:tasks.workunit.client.0.smithi196.stdout:28133943312a test1 2023-11-08T16:38:23.214 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test2 2023-11-08T16:38:23.407 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:23.402+0000 7ffa73213700 0 -- 172.21.15.196:0/2515470951 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x563e04150a20 msgr2=0x563e041f5260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:24.442 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:24.434+0000 7ffa73213700 0 -- 172.21.15.196:0/2515470951 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7ffa54034020 msgr2=0x7ffa54036450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:38:24.499 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:24.503 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -a 2023-11-08T16:38:24.504 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:24.540 INFO:tasks.workunit.client.0.smithi196.stdout:28133943312a test1 2023-11-08T16:38:24.541 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test3 2023-11-08T16:38:24.736 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:24.730+0000 7f81499e5700 0 -- 172.21.15.196:0/1485672567 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55c2239edea0 msgr2=0x55c2239f0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:25.390 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T16:38:25.386+0000 7f81499e5700 0 -- 172.21.15.196:0/1485672567 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7f812c034130 msgr2=0x7f812c036560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:25.480 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:25.484 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd trash ls -a 2023-11-08T16:38:25.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail grep test1 2023-11-08T16:38:25.485 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:25.521 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:38:25.522 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_thick_provision 2023-11-08T16:38:25.522 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing thick provision...' 2023-11-08T16:38:25.522 INFO:tasks.workunit.client.0.smithi196.stdout:testing thick provision... 2023-11-08T16:38:25.523 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:38:25.523 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:25.662 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:25.799 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:25.940 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.218 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.356 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.492 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.627 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.764 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:26.897 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.028 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.164 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.298 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.440 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.562 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.699 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.842 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:27.978 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-11-08T16:38:28.394 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-11-08T16:38:28.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ count=0 2023-11-08T16:38:28.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret= 2023-11-08T16:38:28.412 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 -lt 10 ']' 2023-11-08T16:38:28.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:28.413 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr -s ' ' 2023-11-08T16:38:28.414 INFO:tasks.workunit.client.0.smithi196.stderr:+ cut -d ' ' -f 4-5 2023-11-08T16:38:28.414 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^64 MiB' 2023-11-08T16:38:28.414 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:38:28.466 INFO:tasks.workunit.client.0.smithi196.stdout:64 MiB 2023-11-08T16:38:28.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret=0 2023-11-08T16:38:28.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 = 0 ']' 2023-11-08T16:38:28.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ break 2023-11-08T16:38:28.467 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:38:28.515 INFO:tasks.workunit.client.0.smithi196.stdout:NAME PROVISIONED USED 2023-11-08T16:38:28.516 INFO:tasks.workunit.client.0.smithi196.stdout:test1 64 MiB 64 MiB 2023-11-08T16:38:28.519 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 '!=' 0 ']' 2023-11-08T16:38:28.519 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:28.748 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2023-11-08T16:38:28.742+0000 7f2cb8a53700 0 -- 172.21.15.196:0/2342264602 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7f2c90001530 msgr2=0x7f2c90008c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:28.792 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 100% complete...done. 2023-11-08T16:38:28.796 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:38:28.796 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:28.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:38:28.797 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:28.830 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:38:28.831 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-11-08T16:38:29.428 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2023-11-08T16:38:29.422+0000 7ff6c4d84700 0 -- 172.21.15.196:0/1918248234 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x55cea84281a0 msgr2=0x55cea842a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:29.542 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 6% complete...2023-11-08T16:38:29.534+0000 7ff6c4d84700 0 -- 172.21.15.196:0/1918248234 >> [v2:172.21.15.196:6816/30124,v1:172.21.15.196:6817/30124] conn(0x7ff6a40342e0 msgr2=0x7ff6a4036710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:38:30.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:38:30.786+0000 7f0a1407d700 -1 reset not still connected to 0x55d7ba08a000 2023-11-08T16:38:40.773 INFO:tasks.workunit.client.0.smithi196.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-11-08T16:38:40.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ count=0 2023-11-08T16:38:40.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret= 2023-11-08T16:38:40.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 -lt 10 ']' 2023-11-08T16:38:40.790 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:38:40.791 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:40.791 INFO:tasks.workunit.client.0.smithi196.stderr:+ tr -s ' ' 2023-11-08T16:38:40.791 INFO:tasks.workunit.client.0.smithi196.stderr:+ cut -d ' ' -f 4-5 2023-11-08T16:38:40.792 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^4 GiB' 2023-11-08T16:38:40.846 INFO:tasks.workunit.client.0.smithi196.stdout:4 GiB 2023-11-08T16:38:40.846 INFO:tasks.workunit.client.0.smithi196.stderr:+ ret=0 2023-11-08T16:38:40.847 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 = 0 ']' 2023-11-08T16:38:40.847 INFO:tasks.workunit.client.0.smithi196.stderr:+ break 2023-11-08T16:38:40.847 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd du 2023-11-08T16:38:40.899 INFO:tasks.workunit.client.0.smithi196.stdout:NAME PROVISIONED USED 2023-11-08T16:38:40.900 INFO:tasks.workunit.client.0.smithi196.stdout:test1 4 GiB 4 GiB 2023-11-08T16:38:40.903 INFO:tasks.workunit.client.0.smithi196.stderr:+ '[' 0 '!=' 0 ']' 2023-11-08T16:38:40.904 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd rm test1 2023-11-08T16:38:41.125 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 1% complete... Removing image: 2% complete...2023-11-08T16:38:41.118+0000 7fe0cfddb700 0 -- 172.21.15.196:0/3355242282 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55a46f05e510 msgr2=0x55a46f063b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T16:38:41.151 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 3% complete... Removing image: 4% complete...2023-11-08T16:38:41.146+0000 7fe0cfddb700 0 -- 172.21.15.196:0/3355242282 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x7fe0b0034020 msgr2=0x7fe0b0036450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T16:38:42.245 INFO:tasks.workunit.client.0.smithi196.stderr: Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-11-08T16:38:42.249 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd ls 2023-11-08T16:38:42.250 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test1 2023-11-08T16:38:42.250 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:42.251 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:38:42.286 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:38:42.286 INFO:tasks.workunit.client.0.smithi196.stderr:+ test_namespace 2023-11-08T16:38:42.287 INFO:tasks.workunit.client.0.smithi196.stderr:+ echo 'testing namespace...' 2023-11-08T16:38:42.287 INFO:tasks.workunit.client.0.smithi196.stdout:testing namespace... 2023-11-08T16:38:42.287 INFO:tasks.workunit.client.0.smithi196.stderr:+ remove_images 2023-11-08T16:38:42.288 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:42.406 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:42.537 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:42.678 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:42.816 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:42.942 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.080 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.216 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.349 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.493 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.633 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.775 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:43.915 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.062 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.200 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.338 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.475 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.616 INFO:tasks.workunit.client.0.smithi196.stderr:+ for img in $IMGS 2023-11-08T16:38:44.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace ls 2023-11-08T16:38:44.752 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^0$' 2023-11-08T16:38:44.753 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:44.794 INFO:tasks.workunit.client.0.smithi196.stdout:0 2023-11-08T16:38:44.794 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create rbd/test1 2023-11-08T16:38:44.843 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-11-08T16:38:44.892 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create --namespace test3 2023-11-08T16:38:44.943 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd namespace create rbd/test3 2023-11-08T16:38:44.944 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace create rbd/test3 2023-11-08T16:38:44.981 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: failed to created namespace: 2023-11-08T16:38:44.974+0000 7fab4a55c340 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-11-08T16:38:44.981 INFO:tasks.workunit.client.0.smithi196.stderr:(17) File exists 2023-11-08T16:38:44.984 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:38:44.985 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace list 2023-11-08T16:38:44.985 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep test 2023-11-08T16:38:44.986 INFO:tasks.workunit.client.0.smithi196.stderr:+ wc -l 2023-11-08T16:38:44.986 INFO:tasks.workunit.client.0.smithi196.stderr:+ grep '^3$' 2023-11-08T16:38:45.022 INFO:tasks.workunit.client.0.smithi196.stdout:3 2023-11-08T16:38:45.023 INFO:tasks.workunit.client.0.smithi196.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-11-08T16:38:45.023 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd namespace remove --pool rbd missing 2023-11-08T16:38:45.049 INFO:tasks.workunit.client.0.smithi196.stderr:rbd: namespace name was not specified 2023-11-08T16:38:45.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ return 0 2023-11-08T16:38:45.051 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-11-08T16:38:45.135 INFO:tasks.workunit.client.0.smithi196.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-11-08T16:38:45.206 INFO:tasks.workunit.client.0.smithi196.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-11-08T16:39:16.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:16.489+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.10567.0:493 3.2 3:4910c1a3:test1::rbd_data.2944a8f8eceb.0000000000000097:head [set-alloc-hint object_size 4194304 write_size 4194304,write 802816~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:16.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:16.633+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 68 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:16.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:16.717+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:17.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:17.461+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:17.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:17.625+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:17.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:17.753+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:18.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:18.469+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:18.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:18.585+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:18.787 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:18.785+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:19.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:19.441+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:19.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:19.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:19.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:19.805+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:20.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:20.477+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:20.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:20.521+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:20.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:20.757+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:21.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:21.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:21.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:21.557+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:21.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:21.757+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:22.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:22.473+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:22.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:22.585+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:22.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:22.777+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:23.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:23.509+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:23.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:23.557+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:23.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:23.825+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:24.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:24.473+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:24.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:24.605+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:24.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:24.781+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:25.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:25.481+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:25.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:25.637+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:25.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:25.781+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:26.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:26.457+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:26.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:26.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:26.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:26.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:27.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:27.473+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:27.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:27.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:27.790 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:27.785+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:28.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:28.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:28.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:28.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:28.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:28.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:29.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:29.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:29.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:29.665+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:29.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:29.749+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:30.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:30.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:30.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:30.621+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:30.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:30.741+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:31.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:31.369+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:31.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:31.613+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:31.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:31.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:32.364 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:32.360+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:32.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:32.592+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:32.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:32.732+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:33.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:33.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:33.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:33.632+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:33.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:33.688+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:34.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:34.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:34.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:34.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:34.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:34.728+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:35.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:35.436+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:35.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:35.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:35.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:35.712+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:36.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:36.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:36.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:36.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:36.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:36.716+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:37.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:37.484+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:37.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:37.524+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:37.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:37.716+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:38.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:38.476+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:38.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:38.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:38.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:38.676+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:39.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:39.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:39.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:39.520+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:39.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:39.672+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:40.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:40.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:40.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:40.492+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:40.683 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:40.680+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:41.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:41.516+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:41.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:41.524+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:41.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:41.700+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:42.506 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:42.500+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:42.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:42.508+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:42.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:42.664+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:43.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:43.516+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:43.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:43.520+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:43.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:43.664+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:44.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:44.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:44.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:44.524+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:44.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:44.680+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:45.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:45.500+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:45.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:45.504+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:45.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:45.692+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:46.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:46.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:46.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:46.552+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:46.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:46.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:47.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:47.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:47.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:47.592+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:47.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:47.628+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:48.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:48.384+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:48.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:48.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:48.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:48.628+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:49.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:49.376+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:49.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:49.612+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:49.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:49.632+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:50.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:50.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:50.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:50.624+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:50.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:50.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:51.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:51.340+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:51.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:51.588+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:51.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:51.628+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:52.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:52.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:52.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:52.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:52.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:52.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:53.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:53.312+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:53.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:53.532+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:53.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:53.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:54.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:54.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:54.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:54.540+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:54.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:54.556+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:55.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:55.340+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:55.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:55.520+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:55.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:55.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:56.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:56.296+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:56.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:56.528+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:56.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:56.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:57.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:57.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:57.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:57.500+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:57.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:57.560+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:58.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:58.304+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:58.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:58.532+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:58.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:58.608+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:59.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:39:59.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:39:59.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:39:59.568+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:39:59.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:39:59.632+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:00.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:00.392+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:00.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:00.576+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:00.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:00.680+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:01.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:01.372+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:01.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:01.540+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:01.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:01.716+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:02.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:02.336+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:02.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:02.508+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:02.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:02.736+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:03.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:03.304+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:03.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:03.472+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:03.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:03.700+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:04.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:04.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:04.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:04.484+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:04.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:04.732+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:05.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:05.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:05.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:05.444+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:05.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:05.688+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:06.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:06.384+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:06.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:06.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:06.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:06.664+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:07.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:07.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:07.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:07.460+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:07.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:07.624+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:08.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:08.408+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:08.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:08.504+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:08.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:08.596+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:09.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:09.420+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:09.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:09.468+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:09.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:09.588+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:10.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:10.472+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:10.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:10.504+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:10.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:10.584+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:11.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:11.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:11.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:11.536+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:11.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:11.568+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:12.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:12.488+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:12.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:12.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:12.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:12.596+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:13.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:13.496+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:13.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:13.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:13.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:13.568+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:14.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:14.536+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:14.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:14.540+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:14.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:14.612+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:15.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:15.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:15.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:15.568+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:15.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:15.596+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:16.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:16.532+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:16.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:16.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:16.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:16.560+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:17.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:17.496+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:17.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:17.512+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:17.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:17.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:18.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:18.475+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:18.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:18.535+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:18.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:18.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:19.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:19.499+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:19.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:19.539+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:19.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:19.567+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:20.519 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:20.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:20.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:20.559+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:20.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:20.563+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:21.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:21.519+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:21.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:21.523+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:21.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:21.531+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:22.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:22.471+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:22.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:22.547+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:22.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:22.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:23.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:23.479+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:23.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:23.499+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:23.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:23.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:24.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:24.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:24.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:24.491+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:24.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:24.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:25.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:25.447+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:25.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:25.467+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:25.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:25.567+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:26.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:26.431+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:26.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:26.443+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:26.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:26.551+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:27.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:27.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:27.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:27.471+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:27.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:27.595+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:28.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:28.431+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:28.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:28.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:28.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:28.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:29.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:29.475+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:29.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:29.499+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:29.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:29.643+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:30.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:30.471+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:30.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:30.479+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:30.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:30.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:31.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:31.455+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:31.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:31.463+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:31.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:31.559+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:32.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:32.427+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:32.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:32.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:32.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:32.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:33.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:33.387+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:33.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:33.403+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:33.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:33.559+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:34.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:34.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:34.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:34.431+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:34.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:34.575+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:35.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:35.383+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:35.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:35.451+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:35.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:35.603+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:36.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:36.395+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:36.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:36.439+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:36.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:36.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:37.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:37.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:37.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:37.427+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:37.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:37.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:38.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:38.379+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:38.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:38.451+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:38.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:38.503+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:39.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:39.415+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:39.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:39.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:39.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:39.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:40.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:40.383+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:40.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:40.419+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:40.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:40.459+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:41.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:41.391+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:41.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:41.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:41.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:41.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:42.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:42.371+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:42.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:42.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:42.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:42.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:43.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:43.411+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:43.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:43.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:43.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:43.527+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:44.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:44.427+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:44.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:44.467+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:44.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:44.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:45.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:45.419+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:45.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:45.455+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:45.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:45.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:46.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:46.427+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:46.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:46.467+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:46.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:46.467+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:47.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:47.451+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:47.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:47.495+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:47.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:47.495+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:48.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:48.407+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:48.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:48.515+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:48.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:48.519+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:49.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:49.435+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:49.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:49.479+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:49.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:49.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:50.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:50.435+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:50.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:50.471+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:50.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:50.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:51.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:51.479+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:51.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:51.507+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:51.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:51.519+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:52.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:52.467+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:52.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:52.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:52.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:52.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:53.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:53.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:53.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:53.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:53.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:53.523+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:54.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:54.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:54.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:54.495+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:54.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:54.523+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:55.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:55.455+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:55.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:55.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:55.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:55.555+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:56.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:56.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:56.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:56.523+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:56.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:56.603+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:57.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:57.455+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:57.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:57.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:57.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:57.583+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:58.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:58.479+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:58.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:58.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:58.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:58.623+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:40:59.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:40:59.447+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:59.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:40:59.483+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:40:59.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:40:59.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:00.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:00.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:00.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:00.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:00.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:00.611+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:01.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:01.471+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:01.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:01.543+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:01.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:01.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:02.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:02.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:02.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:02.583+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:02.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:02.635+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:03.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:03.534+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:03.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:03.582+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:03.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:03.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:04.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:04.542+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:04.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:04.542+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:04.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:04.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:05.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:05.530+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:05.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:05.586+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:05.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:05.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:06.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:06.578+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:06.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:06.578+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:06.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:06.610+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:07.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:07.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:07.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:07.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:07.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:07.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:08.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:08.566+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:08.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:08.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:08.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:08.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:09.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:09.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:09.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:09.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:09.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:09.630+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:10.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:10.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:10.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:10.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:10.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:10.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:11.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:11.626+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:11.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:11.630+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:11.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:11.642+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:12.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:12.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:12.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:12.658+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:12.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:12.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:13.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:13.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:13.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:13.674+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:13.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:13.686+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:14.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:14.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:14.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:14.674+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:14.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:14.678+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:15.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:15.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:15.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:15.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:15.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:15.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:16.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:16.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:16.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:16.594+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:16.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:16.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:17.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:17.554+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:17.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:17.566+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:17.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:17.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:18.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:18.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:18.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:18.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:18.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:18.602+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:19.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:19.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:19.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:19.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:19.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:19.650+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:20.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:20.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:20.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:20.622+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:20.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:20.670+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:21.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:21.570+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:21.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:21.638+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:21.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:21.642+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:22.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:22.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:22.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:22.610+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:22.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:22.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:23.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:23.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:23.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:23.654+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:23.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:23.658+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:24.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:24.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:24.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:24.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:24.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:24.702+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:25.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:25.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:25.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:25.662+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:25.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:25.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:26.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:26.574+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:26.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:26.622+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:26.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:26.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:27.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:27.534+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:27.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:27.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:27.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:27.738+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:28.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:28.574+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:28.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:28.654+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:28.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:28.754+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:29.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:29.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:29.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:29.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:29.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:29.802+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:30.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:30.578+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:30.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:30.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:30.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:30.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:31.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:31.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:31.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:31.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:31.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:31.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:32.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:32.586+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:32.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:32.662+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:32.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:32.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:33.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:33.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:33.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:33.694+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:33.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:33.866+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:34.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:34.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:34.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:34.686+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:34.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:34.886+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:35.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:35.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:35.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:35.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:35.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:35.862+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:36.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:36.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:36.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:36.714+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:36.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:36.846+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:37.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:37.630+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:37.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:37.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:37.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:37.882+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:38.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:38.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:38.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:38.702+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:38.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:38.926+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:39.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:39.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:39.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:39.714+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:39.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:39.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:40.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:40.542+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:40.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:40.738+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:40.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:40.954+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:41.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:41.498+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:41.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:41.758+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:41.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:41.922+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:42.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:42.542+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:42.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:42.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:42.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:42.906+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:43.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:43.494+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:43.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:43.754+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:43.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:43.862+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:44.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:44.494+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:44.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:44.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:44.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:44.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:45.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:45.538+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:45.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:45.778+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:45.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:45.826+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:46.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:46.562+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:46.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:46.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:46.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:46.826+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:47.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:47.601+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:47.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:47.805+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:47.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:47.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:48.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:48.637+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:48.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:48.793+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:48.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:48.813+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:49.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:49.649+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:49.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:49.761+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:49.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:49.833+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:50.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:50.689+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:50.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:50.753+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:50.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:50.841+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:51.728 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:51.721+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:51.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:51.785+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:51.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:51.857+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:52.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:52.721+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:52.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:52.749+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:52.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:52.861+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:53.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:53.737+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:53.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:53.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:53.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:53.817+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:54.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:54.705+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:54.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:54.773+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:54.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:54.861+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:55.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:55.673+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:55.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:55.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:55.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:55.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:56.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:56.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:56.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:56.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:56.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:56.841+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:57.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:57.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:57.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:57.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:57.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:57.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:58.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:58.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:58.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:58.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:58.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:58.909+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:41:59.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:41:59.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:59.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:41:59.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:41:59.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:41:59.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:00.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:00.653+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:00.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:00.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:00.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:00.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:01.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:01.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:01.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:01.705+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:01.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:01.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:02.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:02.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:02.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:02.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:02.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:02.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:03.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:03.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:03.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:03.705+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:03.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:03.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:04.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:04.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:04.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:04.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:05.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:04.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:05.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:05.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:05.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:05.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:06.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:06.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:06.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:06.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:06.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:06.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:07.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:07.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:07.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:07.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:07.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:07.709+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:08.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:08.037+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:08.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:08.705+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:08.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:08.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:08.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:08.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:09.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:09.721+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:09.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:09.745+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:09.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:09.981+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:10.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:10.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:10.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:10.745+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:10.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:10.961+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:11.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:11.729+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:11.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:11.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:12.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:12.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:12.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:12.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:12.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:12.773+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:12.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:12.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:13.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:13.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:13.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:13.813+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:13.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:13.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:14.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:14.637+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:14.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:14.777+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:14.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:14.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:15.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:15.589+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:15.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:15.781+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:15.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:15.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:16.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:16.557+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:16.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:16.801+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:16.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:16.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:17.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:17.521+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:17.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:17.825+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:17.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:17.981+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:18.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:18.493+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:18.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:18.833+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:19.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:19.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:19.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:19.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:19.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:19.829+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:20.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:20.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:20.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:20.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:20.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:20.785+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:21.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:21.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:21.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:21.493+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:21.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:21.809+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:21.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:21.993+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:22.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:22.489+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:22.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:22.857+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:22.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:22.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:23.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:23.529+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:23.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:23.853+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:23.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:23.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:24.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:24.501+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:24.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:24.817+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:24.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:24.909+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:25.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:25.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:25.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:25.797+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:25.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:25.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:26.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:26.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:26.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:26.841+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:26.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:26.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:27.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:27.489+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:27.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:27.801+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:27.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:27.981+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:28.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:28.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:28.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:28.825+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:29.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:29.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:29.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:29.521+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:29.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:29.805+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:30.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:30.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:30.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:30.565+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:30.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:30.825+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:31.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:31.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:31.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:31.533+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:31.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:31.841+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:31.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:31.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:32.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:32.565+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:32.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:32.877+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:32.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:32.941+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:33.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:33.573+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:33.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:33.896+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:33.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:33.948+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:34.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:34.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:34.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:34.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:34.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:34.956+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:35.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:35.620+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:35.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:35.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:35.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:35.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:36.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:36.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:36.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:36.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:36.909 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:36.904+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:37.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:37.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:37.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:37.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:37.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:37.936+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:38.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:38.620+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:38.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:38.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:38.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:38.920+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:39.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:39.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:39.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:39.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:39.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:39.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:40.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:40.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:40.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:40.816+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:40.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:40.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:41.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:41.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:41.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:41.796+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:41.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:41.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:42.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:42.680+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:42.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:42.844+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:42.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:42.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:43.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:43.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:43.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:43.864+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:43.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:43.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:44.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:44.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:44.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:44.888+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:44.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:44.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:45.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:45.640+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:45.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:45.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:45.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:45.948+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:46.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:46.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:46.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:46.864+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:46.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:46.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:47.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:47.596+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:47.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:47.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:47.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:47.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:48.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:48.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:48.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:48.908+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:48.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:48.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:49.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:49.620+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:49.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:49.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:49.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:49.904+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:50.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:50.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:50.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:50.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:50.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:50.912+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:51.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:51.580+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:51.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:51.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:51.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:51.896+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:52.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:52.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:52.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:52.872+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:52.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:52.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:53.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:53.560+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:53.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:53.836+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:53.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:53.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:54.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:54.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:54.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:54.804+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:54.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:54.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:55.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:55.552+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:55.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:55.856+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:55.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:55.952+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:56.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:56.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:56.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:56.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:56.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:56.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:57.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:57.516+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:57.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:57.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:57.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:57.960+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:58.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:58.496+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:58.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:58.864+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:58.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:58.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:42:59.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:42:59.468+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:59.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:42:59.856+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:42:59.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:42:59.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:00.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:00.464+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:00.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:00.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:00.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:00.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:01.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:01.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:01.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:01.908+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:01.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:01.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:02.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:02.468+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:02.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:02.948+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:02.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:02.952+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:03.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:03.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:03.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:03.904+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:03.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:03.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:04.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:04.468+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:04.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:04.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:04.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:04.948+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:05.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:05.516+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:05.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:05.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:05.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:05.948+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:06.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:06.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:06.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:06.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:06.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:06.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:07.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:07.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:07.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:07.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:07.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:07.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:08.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:08.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:08.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:08.880+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:09.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:09.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:09.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:09.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:09.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:09.928+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:09.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:09.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:10.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:10.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:10.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:10.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:10.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:10.972+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:11.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:11.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:11.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:11.928+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:11.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:11.984+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:12.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:12.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:12.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:12.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:12.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:12.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:13.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:13.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:13.905 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:13.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:13.979 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:13.976+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:14.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:14.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:14.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:14.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:14.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:14.960+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:15.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:15.436+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:15.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:15.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:15.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:15.964+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:16.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:16.428+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:16.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:16.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:16.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:16.952+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:17.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:17.472+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:17.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:17.896+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:17.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:17.940+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:18.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:18.472+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:18.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:18.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:18.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:18.984+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:19.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:19.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:19.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:19.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:19.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:19.971+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:20.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:20.499+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:20.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:20.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:21.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:21.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:21.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:21.519+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:21.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:21.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:22.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:22.051+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:22.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:22.475+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:22.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:22.955+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:23.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:23.099+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:23.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:23.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:23.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:23.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:24.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:24.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:24.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:24.455+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:24.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:24.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:25.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:25.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:25.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:25.427+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:25.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:25.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:26.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:26.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:26.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:26.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:26.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:26.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:27.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:27.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:27.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:27.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:27.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:27.919+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:28.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:28.187+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:28.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:28.335+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:28.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:28.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:29.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:29.199+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:29.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:29.343+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:29.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:29.879+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:30.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:30.247+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:30.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:30.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:30.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:30.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:31.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:31.263+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:31.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:31.359+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:31.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:31.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:32.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:32.295+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:32.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:32.331+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:32.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:32.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:33.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:33.263+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:33.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:33.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:33.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:33.891+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:34.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:34.315+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:34.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:34.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:34.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:34.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:35.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:35.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:35.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:35.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:35.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:35.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:36.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:36.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:36.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:36.423+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:36.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:36.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:37.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:37.239+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:37.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:37.427+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:37.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:37.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:38.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:38.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:38.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:38.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:38.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:38.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:39.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:39.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:39.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:39.459+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:39.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:39.843+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:40.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:40.199+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:40.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:40.459+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:40.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:40.803+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:41.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:41.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:41.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:41.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:41.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:41.791+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:42.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:42.187+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:42.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:42.499+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:42.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:42.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:43.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:43.187+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:43.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:43.495+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:43.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:43.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:44.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:44.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:44.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:44.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:44.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:44.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:45.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:45.199+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:45.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:45.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:45.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:45.843+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:46.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:46.243+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:46.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:46.547+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:46.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:46.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:47.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:47.251+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:47.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:47.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:47.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:47.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:48.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:48.239+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:48.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:48.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:48.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:48.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:49.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:49.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:49.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:49.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:49.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:49.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:50.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:50.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:50.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:50.595+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:50.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:50.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:51.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:51.243+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:51.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:51.619+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:51.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:51.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:52.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:52.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:52.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:52.643+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:52.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:52.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:53.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:53.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:53.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:53.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:53.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:53.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:54.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:54.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:54.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:54.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:54.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:54.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:55.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:55.319+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:55.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:55.575+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:55.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:55.939+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:56.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:56.319+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:56.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:56.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:56.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:56.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:57.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:57.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:57.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:57.523+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:57.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:57.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:58.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:58.251+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:58.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:58.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:58.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:58.951+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:43:59.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:43:59.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:59.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:43:59.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:43:59.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:43:59.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:00.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:00.219+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:00.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:00.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:00.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:00.983+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:01.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:01.183+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:01.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:01.495+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:02.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:02.027+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:02.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:02.179+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:02.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:02.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:02.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:02.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:03.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:03.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:03.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:03.507+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:03.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:03.951+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:04.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:04.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:04.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:04.503+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:04.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:04.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:05.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:05.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:05.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:05.466+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:05.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:05.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:06.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:06.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:06.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:06.514+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:06.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:06.950+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:07.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:07.146+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:07.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:07.534+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:07.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:07.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:08.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:08.102+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:08.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:08.574+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:08.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:08.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:09.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:09.126+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:09.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:09.602+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:09.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:09.934+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:10.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:10.118+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:10.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:10.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:10.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:10.974+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:11.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:11.146+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:11.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:11.622+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:11.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:11.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:12.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:12.130+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:12.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:12.586+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:12.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:12.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:13.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:13.098+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:13.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:13.574+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:13.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:13.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:14.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:14.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:14.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:14.558+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:14.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:14.950+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:15.066 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:15.058+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:15.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:15.530+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:15.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:15.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:16.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:16.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:16.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:16.550+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:16.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:16.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:17.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:17.110+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:17.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:17.566+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:17.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:17.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:18.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:18.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:18.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:18.602+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:18.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:18.882+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:19.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:19.114+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:19.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:19.602+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:19.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:19.922+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:20.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:20.090+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:20.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:20.630+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:20.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:20.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:21.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:21.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:21.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:21.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:21.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:21.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:22.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:22.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:22.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:22.654+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:22.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:22.962+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:23.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:23.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:23.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:23.638+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:23.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:23.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:24.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:24.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:24.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:24.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:25.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:25.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:25.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:25.150+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:25.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:25.670+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:25.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:25.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:26.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:26.126+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:26.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:26.722+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:27.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:27.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:27.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:27.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:27.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:27.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:28.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:28.050+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:28.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:28.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:28.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:28.686+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:29.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:29.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:29.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:29.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:29.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:29.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:30.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:30.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:30.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:30.142+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:30.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:30.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:31.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:31.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:31.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:31.114+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:31.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:31.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:32.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:32.150+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:32.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:32.150+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:32.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:32.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:33.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:33.142+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:33.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:33.182+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:33.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:33.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:34.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:34.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:34.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:34.186+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:34.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:34.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:35.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:35.146+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:35.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:35.206+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:35.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:35.662+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:36.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:36.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:36.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:36.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:36.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:36.638+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:37.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:37.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:37.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:37.174+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:37.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:37.618+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:38.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:38.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:38.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:38.146+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:38.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:38.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:39.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:39.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:39.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:39.142+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:39.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:39.586+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:40.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:40.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:40.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:40.174+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:40.586 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:40.578+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:41.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:41.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:41.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:41.198+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:41.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:41.606+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:42.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:42.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:42.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:42.166+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:42.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:42.646+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:43.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:43.074+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:43.186 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:43.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:43.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:43.610+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:44.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:44.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:44.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:44.210+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:44.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:44.622+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:45.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:45.098+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:45.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:45.254+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:45.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:45.574+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:46.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:46.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:46.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:46.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:46.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:46.562+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:47.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:47.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:47.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:47.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:47.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:47.562+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:48.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:48.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:48.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:48.222+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:48.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:48.606+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:49.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:49.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:49.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:49.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:49.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:49.626+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:50.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:50.174+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:50.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:50.222+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:50.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:50.617+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:51.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:51.165+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:51.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:51.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:51.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:51.641+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:52.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:52.189+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:52.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:52.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:52.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:52.617+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:53.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:53.173+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:53.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:53.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:53.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:53.601+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:54.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:54.185+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:54.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:54.229+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:54.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:54.593+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:55.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:55.153+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:55.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:55.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:55.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:55.593+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:56.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:56.153+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:56.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:56.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:56.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:56.541+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:57.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:57.161+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:57.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:57.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:57.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:57.529+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:58.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:58.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:58.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:58.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:58.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:58.497+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:59.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:44:59.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:44:59.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:44:59.129+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:44:59.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:44:59.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:00.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:00.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:00.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:00.117+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:00.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:00.489+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:01.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:01.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:01.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:01.081+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:01.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:01.489+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:02.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:02.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:02.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:02.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:02.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:02.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:03.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:03.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:03.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:03.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:03.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:03.569+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:04.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:04.081+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:04.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:04.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:04.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:04.585+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:05.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:05.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:05.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:05.121+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:05.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:05.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:06.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:06.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:06.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:06.113+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:06.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:06.549+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:07.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:07.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:07.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:07.145+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:07.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:07.541+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:08.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:08.181+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:08.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:08.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:08.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:08.537+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:09.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:09.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:09.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:09.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:09.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:09.501+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:10.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:10.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:10.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:10.181+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:10.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:10.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:11.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:11.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:11.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:11.221+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:11.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:11.565+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:12.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:12.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:12.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:12.185+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:12.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:12.521+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:13.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:13.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:13.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:13.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:13.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:13.529+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:14.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:14.241+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:14.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:14.269+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:14.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:14.549+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:15.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:15.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:15.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:15.225+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:15.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:15.505+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:16.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:16.205+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:16.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:16.225+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:16.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:16.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:17.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:17.213+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:17.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:17.225+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:17.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:17.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:18.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:18.165+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:18.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:18.189+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:18.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:18.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:19.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:19.137+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:19.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:19.189+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:19.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:19.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:20.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:20.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:20.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:20.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:20.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:20.509+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:21.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:21.097+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:21.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:21.245+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:21.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:21.541+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:22.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:22.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:22.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:22.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:22.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:22.577+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:23.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:23.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:23.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:23.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:23.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:23.573+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:24.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:24.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:24.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:24.333+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:24.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:24.593+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:25.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:25.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:25.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:25.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:25.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:25.601+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:26.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:26.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:26.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:26.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:26.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:26.633+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:27.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:27.097+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:27.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:27.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:27.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:27.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:28.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:28.101+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:28.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:28.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:28.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:28.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:29.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:29.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:29.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:29.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:29.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:29.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:30.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:30.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:30.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:30.281+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:30.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:30.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:31.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:31.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:31.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:31.245+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:31.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:31.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:32.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:32.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:32.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:32.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:32.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:32.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:33.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:33.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:33.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:33.325+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:33.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:33.785+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:34.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:34.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:34.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:34.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:34.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:34.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:34.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:34.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:35.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:35.268+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:35.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:35.724+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:35.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:35.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:36.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:36.228+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:36.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:36.680+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:36.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:36.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:37.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:37.200+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:37.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:37.640+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:37.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:37.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:38.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:38.236+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:38.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:38.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:38.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:38.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:39.209 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:39.204+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:39.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:39.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:39.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:39.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:40.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:40.192+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:40.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:40.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:40.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:40.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:41.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:41.208+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:41.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:41.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:41.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:41.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:42.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:42.244+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:42.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:42.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:42.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:42.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:43.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:43.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:43.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:43.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:43.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:43.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:44.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:44.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:44.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:44.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:44.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:44.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:45.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:45.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:45.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:45.628+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:45.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:45.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:46.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:46.172+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:46.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:46.596+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:46.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:46.860+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:47.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:47.192+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:47.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:47.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:47.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:47.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:48.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:48.184+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:48.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:48.652+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:48.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:48.872+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:49.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:49.136+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:49.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:49.680+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:49.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:49.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:50.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:50.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:50.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:50.700+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:50.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:50.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:51.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:51.128+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:51.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:51.720+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:51.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:51.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:52.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:52.128+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:52.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:52.720+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:52.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:52.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:53.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:53.136+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:53.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:53.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:53.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:53.896+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:54.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:54.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:54.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:54.776+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:54.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:54.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:55.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:55.112+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:55.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:55.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:55.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:55.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:56.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:56.068+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:56.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:56.764+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:56.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:56.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:57.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:57.024+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:57.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:57.772+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:57.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:57.896+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:58.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:58.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:58.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:58.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:58.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:58.928+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:45:59.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:45:59.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:59.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:45:59.756+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:45:59.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:45:59.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:00.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:00.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:00.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:00.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:00.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:00.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:00.996 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:00.992+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:01.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:01.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:01.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:01.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:02.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:02.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:02.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:02.684+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:02.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:02.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:03.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:03.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:03.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:03.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:03.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:03.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:04.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:04.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:04.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:04.632+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:04.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:04.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:05.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:05.076+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:05.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:05.620+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:05.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:05.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:06.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:06.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:06.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:06.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:06.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:06.800+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:07.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:07.120+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:07.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:07.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:07.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:07.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:08.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:08.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:08.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:08.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:08.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:08.852+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:09.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:09.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:09.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:09.708+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:09.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:09.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:10.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:10.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:10.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:10.720+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:10.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:10.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:11.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:11.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:11.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:11.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:11.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:11.860+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:12.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:12.124+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:12.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:12.768+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:12.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:12.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:13.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:13.124+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:13.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:13.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:13.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:13.868+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:14.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:14.136+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:14.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:14.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:14.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:14.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:15.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:15.140+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:15.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:15.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:15.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:15.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:16.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:16.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:16.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:16.712+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:16.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:16.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:17.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:17.160+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:17.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:17.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:17.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:17.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:18.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:18.184+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:18.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:18.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:18.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:18.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:19.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:19.224+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:19.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:19.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:19.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:19.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:20.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:20.207+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:20.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:20.795+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:20.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:20.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:21.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:21.187+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:21.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:21.835+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:21.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:21.931+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:22.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:22.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:22.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:22.875+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:22.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:22.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:23.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:23.139+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:23.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:23.843+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:23.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:23.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:24.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:24.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:24.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:24.859+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:24.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:24.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:25.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:25.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:25.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:25.903+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:25.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:25.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:26.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:26.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:26.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:26.927+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:26.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:26.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:27.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:27.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:27.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:27.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:27.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:27.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:28.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:28.115+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:28.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:28.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:28.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:28.975+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:29.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:29.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:29.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:29.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:29.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:29.983+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:30.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:30.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:30.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:30.951+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:31.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:30.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:31.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:31.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:31.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:31.959+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:32.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:32.035+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:32.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:32.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:32.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:32.955+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:33.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:33.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:33.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:33.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:33.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:33.927+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:34.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:34.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:34.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:34.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:34.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:34.911+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:35.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:35.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:35.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:35.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:35.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:35.939+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:36.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:36.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:36.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:36.271+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:36.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:36.971+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:36.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:36.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:37.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:37.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:37.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:37.931+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:37.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:37.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:38.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:38.339+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:38.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:38.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:38.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:38.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:39.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:39.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:39.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:39.911+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:39.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:39.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:40.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:40.307+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:40.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:40.867+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:40.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:40.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:41.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:41.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:41.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:41.895+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:41.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:41.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:42.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:42.255+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:42.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:42.887+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:42.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:42.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:43.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:43.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:43.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:43.923+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:43.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:43.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:44.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:44.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:44.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:44.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:44.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:44.943+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:45.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:45.375+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:45.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:45.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:45.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:45.971+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:46.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:46.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:46.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:46.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:46.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:46.995+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:47.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:47.371+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:47.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:47.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:47.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:47.959+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:48.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:48.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:48.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:48.915+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:48.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:48.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:49.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:49.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:49.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:49.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:49.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:49.963+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:50.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:50.415+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:50.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:50.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:50.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:50.983+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:51.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:51.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:51.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:51.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:51.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:51.991+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:52.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:52.439+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:52.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:52.867+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:52.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:52.959+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:53.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:53.423+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:53.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:53.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:53.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:53.983+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:54.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:54.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:54.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:54.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:55.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:55.019+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:55.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:55.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:55.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:55.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:56.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:56.019+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:56.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:56.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:56.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:56.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:57.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:57.039+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:57.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:57.331+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:57.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:57.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:58.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:58.027+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:58.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:58.315+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:58.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:58.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:46:59.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:46:59.027+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:59.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:46:59.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:46:59.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:46:59.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:00.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:00.019+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:00.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:00.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:00.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:00.955+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:01.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:01.003+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:01.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:01.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:01.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:01.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:02.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:02.019+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:02.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:02.347+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:02.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:02.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:03.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:02.995+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:03.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:03.335+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:03.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:03.971+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:03.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:03.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:04.350 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:04.343+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:04.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:04.938+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:04.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:04.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:05.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:05.350+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:05.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:05.950+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:05.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:05.950+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:06.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:06.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:06.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:06.958+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:06.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:06.982+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:07.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:07.334+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:07.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:07.990+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:08.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:08.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:08.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:08.386+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:08.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:08.962+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:09.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:09.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:09.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:09.350+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:09.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:09.942+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:09.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:09.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:10.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:10.366+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:10.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:10.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:11.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:11.026+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:11.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:11.366+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:11.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:11.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:12.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:12.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:12.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:12.382+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:12.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:12.970+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:13.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:13.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:13.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:13.374+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:13.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:13.922+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:14.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:14.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:14.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:14.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:14.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:14.970+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:15.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:15.082+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:15.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:15.290+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:15.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:15.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:16.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:16.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:16.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:16.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:17.008 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:17.002+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:17.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:17.050+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:17.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:17.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:18.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:17.994+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:18.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:18.078+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:18.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:18.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:19.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:19.026+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:19.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:19.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:19.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:19.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:20.033 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:20.026+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:20.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:20.082+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:20.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:20.238+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:21.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:21.050+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:21.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:21.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:21.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:21.246+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:22.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:22.082+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:22.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:22.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:22.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:22.226+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:23.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:23.102+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:23.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:23.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:23.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:23.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:24.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:24.138+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:24.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:24.162+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:24.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:24.274+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:25.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:25.106+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:25.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:25.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:25.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:25.230+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:26.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:26.106+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:26.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:26.138+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:26.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:26.210+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:27.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:27.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:27.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:27.142+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:27.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:27.190+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:28.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:28.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:28.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:28.178+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:28.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:28.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:29.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:29.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:29.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:29.178+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:29.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:29.198+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:30.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:30.118+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:30.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:30.166+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:30.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:30.206+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:31.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:31.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:31.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:31.182+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:31.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:31.202+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:32.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:32.146+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:32.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:32.154+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:32.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:32.222+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:33.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:33.158+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:33.176 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:33.170+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:33.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:33.210+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:34.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:34.162+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:34.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:34.162+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:34.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:34.182+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:35.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:35.122+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:35.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:35.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:35.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:35.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:36.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:36.090+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:36.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:36.202+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:36.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:36.238+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:37.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:37.070+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:37.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:37.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:37.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:37.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:38.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:38.026+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:38.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:38.182+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:38.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:38.314+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:39.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:39.046+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:39.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:39.202+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:39.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:39.346+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:40.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:40.006+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:40.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:40.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:40.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:40.378+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:40.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:40.994+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:41.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:41.186+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:41.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:41.330+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:41.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:41.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:42.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:42.138+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:42.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:42.374+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:42.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:42.922+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:43.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:43.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:43.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:43.374+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:43.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:43.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:44.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:44.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:44.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:44.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:44.906 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:44.898+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:45.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:45.082+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:45.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:45.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:45.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:45.918+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:46.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:46.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:46.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:46.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:46.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:46.906+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:47.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:47.058+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:47.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:47.350+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:47.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:47.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:48.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:48.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:48.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:48.398+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:48.895 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:48.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:49.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:49.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:49.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:49.397+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:49.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:49.853+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:50.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:49.993+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:50.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:50.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:50.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:50.849+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:50.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:50.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:51.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:51.397+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:51.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:51.829+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:52.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:51.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:52.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:52.373+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:52.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:52.813+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:53.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:53.001+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:53.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:53.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:53.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:53.809+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:54.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:54.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:54.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:54.341+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:54.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:54.769+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:54.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:54.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:55.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:55.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:55.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:55.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:55.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:55.917+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:56.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:56.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:56.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:56.801+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:56.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:56.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:57.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:57.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:57.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:57.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:57.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:57.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:58.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:58.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:58.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:58.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:58.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:58.909+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:47:59.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:47:59.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:59.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:47:59.829+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:47:59.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:47:59.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:00.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:00.321+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:00.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:00.809+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:00.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:00.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:01.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:01.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:01.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:01.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:01.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:01.881+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:02.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:02.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:02.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:02.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:02.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:02.841+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:03.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:03.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:03.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:03.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:03.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:03.793+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:04.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:04.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:04.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:04.769+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:04.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:04.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:05.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:05.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:05.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:05.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:05.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:05.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:06.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:06.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:06.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:06.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:06.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:06.825+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:07.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:07.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:07.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:07.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:07.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:07.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:08.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:08.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:08.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:08.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:08.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:08.881+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:09.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:09.201+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:09.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:09.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:09.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:09.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:10.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:10.237+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:10.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:10.653+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:10.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:10.897+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:11.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:11.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:11.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:11.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:11.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:11.941+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:12.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:12.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:12.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:12.745+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:12.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:12.941+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:13.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:13.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:13.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:13.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:13.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:13.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:14.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:14.161+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:14.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:14.765+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:14.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:14.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:15.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:15.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:15.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:15.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:15.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:15.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:16.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:16.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:16.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:16.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:16.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:16.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:17.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:17.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:17.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:17.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:17.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:17.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:18.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:18.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:18.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:18.693+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:19.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:19.001+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:19.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:19.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:19.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:19.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:19.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:19.993+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:20.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:20.137+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:20.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:20.697+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:21.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:21.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:21.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:21.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:21.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:21.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:22.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:22.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:22.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:22.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:22.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:22.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:23.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:23.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:23.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:23.121+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:23.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:23.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:24.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:24.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:24.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:24.085+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:24.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:24.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:25.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:25.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:25.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:25.065+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:25.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:25.685+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:26.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:26.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:26.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:26.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:26.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:26.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:27.024 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:27.021+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:27.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:27.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:27.681 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:27.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:28.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:28.049+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:28.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:28.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:28.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:28.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:29.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:29.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:29.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:29.065+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:29.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:29.693+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:30.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:30.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:30.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:30.081+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:30.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:30.645+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:31.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:31.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:31.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:31.065+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:31.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:31.685+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:32.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:32.053+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:32.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:32.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:32.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:32.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:33.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:33.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:33.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:33.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:33.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:33.688+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:34.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:34.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:34.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:34.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:34.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:34.716+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:35.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:35.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:35.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:35.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:35.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:35.688+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:36.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:36.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:36.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:36.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:36.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:36.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:37.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:37.064+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:37.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:37.156+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:37.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:37.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:38.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:38.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:38.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:38.176+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:38.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:38.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:39.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:39.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:39.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:39.136+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:39.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:39.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:39.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:39.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:40.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:40.128+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:40.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:40.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:40.996 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:40.992+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:41.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:41.156+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:41.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:41.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:42.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:42.028+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:42.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:42.196+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:42.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:42.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:43.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:43.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:43.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:43.212+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:43.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:43.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:44.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:44.064+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:44.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:44.216+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:44.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:44.640+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:45.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:45.076+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:45.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:45.224+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:45.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:45.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:46.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:46.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:46.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:46.200+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:46.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:46.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:47.066 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:47.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:47.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:47.208+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:47.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:47.612+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:48.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:48.104+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:48.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:48.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:48.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:48.640+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:49.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:49.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:49.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:49.192+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:49.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:49.600+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:50.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:50.024+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:50.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:50.216+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:50.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:50.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:51.075 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:51.072+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:51.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:51.220+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:51.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:51.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:52.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:52.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:52.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:52.192+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:52.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:52.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:53.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:53.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:53.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:53.204+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:53.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:53.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:54.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:53.996+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:54.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:54.240+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:54.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:54.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:55.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:55.020+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:55.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:55.192+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:55.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:55.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:56.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:56.064+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:56.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:56.156+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:56.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:56.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:57.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:57.028+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:57.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:57.164+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:57.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:57.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:58.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:58.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:58.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:58.172+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:58.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:58.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:59.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:48:59.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:48:59.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:48:59.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:48:59.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:48:59.568+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:00.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:00.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:00.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:00.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:00.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:00.612+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:01.029 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:01.024+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:01.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:01.124+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:01.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:01.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:02.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:02.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:02.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:02.092+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:02.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:02.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:03.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:03.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:03.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:03.140+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:03.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:03.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:04.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:04.032+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:04.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:04.120+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:04.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:04.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:05.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:05.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:05.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:05.072+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:05.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:05.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:06.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:06.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:06.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:06.116+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:06.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:06.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:07.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:07.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:07.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:07.128+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:07.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:07.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:08.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:08.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:08.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:08.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:08.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:08.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:09.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:09.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:09.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:09.136+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:09.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:09.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:10.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:10.024+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:10.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:10.148+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:10.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:10.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:11.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:11.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:11.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:11.132+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:11.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:11.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:12.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:12.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:12.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:12.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:12.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:12.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:13.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:13.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:13.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:13.132+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:13.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:13.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:14.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:14.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:14.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:14.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:14.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:14.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:15.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:15.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:15.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:15.104+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:15.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:15.572+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:15.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:15.972+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:16.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:16.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:16.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:16.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:16.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:16.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:17.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:17.095+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:17.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:17.499+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:17.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:17.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:18.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:18.139+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:18.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:18.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:18.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:18.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:19.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:19.099+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:19.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:19.567+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:19.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:19.891+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:20.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:20.059+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:20.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:20.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:20.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:20.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:21.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:21.035+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:21.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:21.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:21.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:21.835+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:22.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:22.071+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:22.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:22.567+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:22.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:22.847+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:23.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:23.119+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:23.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:23.543+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:23.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:23.887+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:24.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:24.115+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:24.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:24.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:24.903 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:24.899+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:25.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:25.083+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:25.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:25.519+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:25.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:25.867+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:26.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:26.127+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:26.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:26.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:26.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:26.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:27.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:27.091+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:27.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:27.471+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:27.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:27.867+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:28.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:28.107+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:28.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:28.483+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:28.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:28.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:29.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:29.091+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:29.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:29.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:29.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:29.871+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:30.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:30.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:30.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:30.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:30.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:30.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:31.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:31.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:31.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:31.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:31.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:31.911+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:32.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:32.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:32.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:32.467+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:32.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:32.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:33.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:33.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:33.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:33.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:33.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:33.931+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:33.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:33.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:34.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:34.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:34.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:34.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:35.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:35.023+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:35.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:35.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:35.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:35.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:36.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:36.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:36.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:36.575+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:36.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:36.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:37.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:37.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:37.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:37.587+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:37.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:37.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:38.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:38.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:38.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:38.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:38.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:38.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:39.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:39.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:39.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:39.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:39.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:39.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:39.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:39.979+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:40.557 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:40.551+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:40.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:40.951+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:41.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:40.999+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:41.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:41.539+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:41.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:41.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:41.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:41.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:42.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:42.587+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:42.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:42.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:43.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:43.003+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:43.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:43.607+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:43.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:43.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:44.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:44.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:44.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:44.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:44.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:44.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:45.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:45.027+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:45.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:45.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:45.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:45.987+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:45.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:45.991+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:46.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:46.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:46.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:46.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:46.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:46.971+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:47.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:47.523+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:47.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:47.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:47.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:47.963+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:48.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:48.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:48.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:48.915+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:48.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:48.915+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:49.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:49.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:49.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:49.887+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:49.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:49.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:50.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:50.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:50.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:50.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:50.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:50.903+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:51.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:51.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:51.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:51.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:51.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:51.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:52.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:52.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:52.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:52.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:52.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:52.899+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:53.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:53.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:53.921 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:53.915+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:53.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:53.915+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:54.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:54.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:54.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:54.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:54.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:54.919+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:55.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:55.539+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:55.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:55.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:55.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:55.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:56.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:56.583+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:56.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:56.859+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:56.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:56.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:57.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:57.547+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:57.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:57.815+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:57.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:57.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:58.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:58.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:58.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:58.803+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:58.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:58.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:49:59.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:49:59.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:59.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:49:59.787+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:49:59.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:49:59.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:00.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:00.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:00.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:00.747+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:00.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:00.867+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:01.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:01.442+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:01.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:01.722+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:01.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:01.870+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:02.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:02.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:02.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:02.718+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:02.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:02.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:03.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:03.434+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:03.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:03.726+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:03.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:03.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:04.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:04.446+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:04.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:04.718+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:04.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:04.846+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:05.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:05.462+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:05.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:05.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:05.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:05.866+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:06.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:06.510+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:06.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:06.750+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:06.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:06.886+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:07.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:07.554+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:07.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:07.766+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:07.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:07.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:08.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:08.538+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:08.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:08.778+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:08.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:08.882+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:09.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:09.542+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:09.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:09.778+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:09.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:09.894+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:10.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:10.526+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:10.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:10.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:10.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:10.910+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:11.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:11.522+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:11.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:11.830+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:11.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:11.878+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:12.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:12.478+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:12.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:12.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:12.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:12.914+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:13.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:13.514+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:13.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:13.850+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:13.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:13.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:14.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:14.486+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:14.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:14.870+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:14.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:14.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:15.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:15.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:15.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:15.858+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:15.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:15.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:16.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:16.470+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:16.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:16.854+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:16.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:16.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:17.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:17.442+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:17.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:17.830+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:17.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:17.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:18.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:18.490+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:18.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:18.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:19.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:19.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:19.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:19.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:19.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:19.838+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:20.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:20.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:20.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:20.534+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:20.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:20.810+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:21.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:21.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:21.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:21.494+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:21.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:21.806+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:22.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:22.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:22.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:22.466+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:22.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:22.766+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:23.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:23.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:23.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:23.458+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:23.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:23.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:24.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:24.054+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:24.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:24.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:24.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:24.702+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:25.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:25.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:25.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:25.482+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:25.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:25.654+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:26.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:26.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:26.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:26.442+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:26.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:26.654+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:27.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:27.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:27.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:27.446+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:27.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:27.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:28.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:28.182+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:28.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:28.454+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:28.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:28.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:29.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:29.182+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:29.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:29.470+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:29.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:29.686+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:30.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:30.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:30.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:30.514+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:30.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:30.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:31.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:31.202+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:31.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:31.486+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:31.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:31.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:32.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:32.154+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:32.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:32.454+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:32.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:32.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:33.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:33.138+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:33.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:33.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:33.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:33.750+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:34.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:34.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:34.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:34.478+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:34.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:34.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:35.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:35.098+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:35.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:35.498+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:35.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:35.770+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:36.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:36.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:36.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:36.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:36.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:36.786+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:37.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:37.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:37.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:37.486+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:37.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:37.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:38.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:38.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:38.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:38.466+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:38.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:38.830+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:39.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:39.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:39.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:39.506+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:39.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:39.834+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:40.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:40.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:40.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:40.462+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:40.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:40.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:41.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:41.050+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:41.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:41.430+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:41.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:41.866+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:42.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:41.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:42.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:42.422+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:42.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:42.878+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:43.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:43.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:43.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:43.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:43.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:43.834+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:44.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:43.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:44.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:44.402+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:44.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:44.870+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:45.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:45.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:45.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:45.358+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:45.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:45.906+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:46.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:46.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:46.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:46.346+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:46.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:46.914+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:47.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:47.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:47.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:47.338+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:47.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:47.953+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:47.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:47.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:48.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:48.357+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:48.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:48.965+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:49.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:49.001+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:49.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:49.381+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:49.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:49.941+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:50.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:50.001+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:50.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:50.341+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:50.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:50.901+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:50.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:50.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:51.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:51.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:51.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:51.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:52.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:52.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:52.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:52.317+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:52.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:52.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:52.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:52.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:53.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:53.277+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:53.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:53.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:54.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:54.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:54.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:54.273+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:54.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:54.977+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:55.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:55.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:55.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:55.297+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:55.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:55.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:56.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:56.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:56.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:56.253+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:57.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:56.993+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:57.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:57.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:57.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:57.233+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:57.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:57.957+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:58.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:58.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:58.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:58.273+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:59.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:59.001+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:59.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:50:59.001+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:50:59.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:50:59.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:50:59.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:50:59.957+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:00.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:00.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:00.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:00.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:00.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:00.933+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:01.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:01.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:01.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:01.313+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:01.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:01.921+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:02.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:02.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:02.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:02.309+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:02.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:02.917+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:02.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:02.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:03.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:03.277+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:03.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:03.893+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:04.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:03.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:04.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:04.285+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:04.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:04.937+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:05.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:04.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:05.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:05.317+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:05.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:05.893+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:05.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:05.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:06.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:06.297+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:06.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:06.877+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:06.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:06.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:07.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:07.333+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:07.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:07.921+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:07.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:07.949+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:08.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:08.337+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:08.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:08.873+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:08.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:08.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:09.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:09.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:09.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:09.825+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:09.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:09.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:10.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:10.353+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:10.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:10.793+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:10.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:10.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:11.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:11.405+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:11.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:11.817+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:11.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:11.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:12.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:12.369+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:12.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:12.813+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:12.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:12.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:13.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:13.369+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:13.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:13.833+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:13.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:13.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:14.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:14.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:14.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:14.881+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:14.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:14.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:15.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:15.297+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:15.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:15.909+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:15.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:15.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:16.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:16.349+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:16.905 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:16.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:16.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:16.957+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:17.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:17.317+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:17.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:17.913+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:17.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:17.937+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:18.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:18.361+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:18.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:18.885+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:18.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:18.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:19.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:19.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:19.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:19.873+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:19.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:19.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:20.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:20.277+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:20.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:20.829+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:20.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:20.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:21.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:21.293+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:21.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:21.865+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:21.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:21.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:22.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:22.313+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:22.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:22.845+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:22.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:22.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:23.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:23.337+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:23.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:23.845+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:23.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:23.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:24.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:24.389+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:24.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:24.813+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:24.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:24.857+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:25.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:25.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:25.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:25.781+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:25.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:25.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:26.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:26.349+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:26.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:26.757+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:26.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:26.881+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:27.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:27.369+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:27.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:27.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:27.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:27.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:28.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:28.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:28.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:28.721+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:28.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:28.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:29.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:29.389+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:29.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:29.773+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:29.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:29.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:30.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:30.373+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:30.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:30.809+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:30.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:30.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:31.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:31.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:31.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:31.761+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:31.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:31.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:32.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:32.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:32.740 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:32.737+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:32.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:32.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:33.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:33.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:33.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:33.721+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:33.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:33.841+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:34.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:34.409+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:34.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:34.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:34.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:34.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:35.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:35.381+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:35.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:35.661+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:35.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:35.805+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:36.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:36.417+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:36.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:36.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:36.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:36.757+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:37.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:37.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:37.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:37.717+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:37.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:37.721+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:38.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:38.489+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:38.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:38.701+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:38.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:38.733+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:39.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:39.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:39.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:39.708+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:39.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:39.712+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:40.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:40.452+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:40.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:40.724+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:40.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:40.728+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:41.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:41.460+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:41.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:41.732+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:41.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:41.768+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:42.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:42.448+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:42.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:42.760+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:42.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:42.772+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:43.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:43.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:43.769 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:43.764+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:43.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:43.768+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:44.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:44.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:44.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:44.744+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:44.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:44.800+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:45.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:45.496+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:45.712 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:45.708+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:45.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:45.844+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:46.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:46.524+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:46.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:46.732+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:46.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:46.896+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:47.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:47.500+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:47.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:47.752+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:47.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:47.916+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:48.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:48.528+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:48.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:48.748+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:48.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:48.876+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:49.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:49.540+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:49.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:49.708+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:49.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:49.880+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:50.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:50.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:50.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:50.748+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:50.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:50.856+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:51.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:51.520+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:51.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:51.792+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:51.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:51.880+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:52.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:52.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:52.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:52.780+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:52.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:52.924+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:53.449 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:53.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:53.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:53.816+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:53.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:53.872+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:54.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:54.412+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:54.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:54.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:54.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:54.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:55.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:55.376+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:55.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:55.836+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:55.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:55.920+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:56.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:56.416+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:56.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:56.840+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:56.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:56.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:57.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:57.424+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:57.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:57.848+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:57.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:57.960+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:58.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:58.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:58.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:58.800+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:51:58.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:51:58.968+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:59.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:51:59.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:51:59.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:51:59.776+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:00.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:00.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:00.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:00.520+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:00.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:00.756+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:01.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:01.016+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:01.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:01.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:01.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:01.744+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:02.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:02.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:02.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:02.552+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:02.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:02.728+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:03.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:03.028+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:03.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:03.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:03.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:03.752+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:04.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:04.016+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:04.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:04.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:04.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:04.748+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:05.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:05.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:05.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:05.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:05.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:05.772+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:06.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:06.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:06.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:06.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:06.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:06.804+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:06.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:06.960+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:07.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:07.448+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:07.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:07.792+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:07.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:07.980+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:08.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:08.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:08.787 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:08.784+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:09.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:09.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:09.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:09.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:09.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:09.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:10.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:09.996+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:10.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:10.480+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:10.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:10.828+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:11.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:11.012+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:11.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:11.524+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:11.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:11.816+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:12.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:12.052+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:12.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:12.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:12.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:12.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:13.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:13.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:13.506 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:13.500+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:13.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:13.820+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:14.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:14.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:14.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:14.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:14.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:14.860+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:15.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:15.124+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:15.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:15.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:15.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:15.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:16.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:16.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:16.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:16.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:16.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:16.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:17.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:17.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:17.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:17.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:17.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:17.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:18.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:18.132+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:18.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:18.500+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:18.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:18.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:19.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:19.152+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:19.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:19.460+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:19.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:19.920+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:20.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:20.128+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:20.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:20.460+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:20.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:20.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:21.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:21.152+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:21.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:21.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:21.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:21.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:22.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:22.152+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:22.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:22.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:22.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:22.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:23.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:23.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:23.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:23.552+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:23.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:23.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:24.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:24.164+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:24.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:24.568+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:25.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:24.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:25.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:25.136+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:25.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:25.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:26.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:26.036+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:26.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:26.112+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:26.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:26.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:27.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:27.068+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:27.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:27.156+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:27.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:27.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:28.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:28.100+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:28.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:28.156+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:28.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:28.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:29.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:29.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:29.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:29.152+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:29.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:29.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:30.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:30.115+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:30.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:30.155+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:30.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:30.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:31.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:31.119+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:31.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:31.131+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:31.449 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:31.443+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:32.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:32.095+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:32.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:32.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:32.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:32.431+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:33.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:33.115+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:33.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:33.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:33.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:33.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:34.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:34.071+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:34.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:34.175+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:34.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:34.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:35.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:35.087+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:35.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:35.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:35.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:35.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:36.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:36.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:36.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:36.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:36.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:36.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:37.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:37.079+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:37.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:37.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:37.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:37.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:38.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:38.059+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:38.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:38.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:38.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:38.459+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:39.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:39.059+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:39.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:39.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:39.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:39.503+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:40.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:40.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:40.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:40.211+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:40.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:40.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:40.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:40.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:41.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:41.215+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:41.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:41.471+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:41.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:41.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:42.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:42.211+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:42.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:42.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:42.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:42.931+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:43.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:43.175+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:43.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:43.475+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:43.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:43.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:44.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:44.151+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:44.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:44.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:44.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:44.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:45.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:45.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:45.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:45.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:45.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:45.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:46.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:46.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:46.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:46.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:46.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:46.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:47.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:47.107+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:47.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:47.531+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:47.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:47.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:48.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:48.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:48.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:48.571+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:48.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:48.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:49.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:49.087+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:49.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:49.579+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:49.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:49.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:50.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:50.055+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:50.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:50.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:50.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:50.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:51.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:51.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:51.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:51.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:51.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:51.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:52.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:52.063+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:52.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:52.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:52.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:52.879+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:53.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:53.035+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:53.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:53.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:53.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:53.915+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:54.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:54.011+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:54.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:54.495+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:54.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:54.939+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:55.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:55.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:55.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:55.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:55.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:55.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:56.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:55.999+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:56.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:56.503+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:56.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:56.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:56.996 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:56.991+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:57.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:57.495+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:57.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:57.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:58.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:58.015+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:58.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:58.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:58.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:58.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:52:59.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:52:58.999+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:59.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:52:59.491+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:52:59.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:52:59.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:00.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:00.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:00.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:00.523+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:00.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:00.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:00.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:00.971+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:01.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:01.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:01.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:01.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:01.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:01.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:02.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:02.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:02.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:02.779+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:02.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:02.911+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:03.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:03.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:03.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:03.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:03.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:03.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:04.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:04.515+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:04.790 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:04.783+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:04.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:04.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:05.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:05.511+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:05.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:05.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:05.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:05.871+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:06.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:06.535+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:06.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:06.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:06.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:06.831+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:07.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:07.587+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:07.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:07.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:07.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:07.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:08.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:08.603+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:08.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:08.827+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:08.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:08.887+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:09.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:09.583+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:09.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:09.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:09.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:09.891+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:10.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:10.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:10.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:10.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:10.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:10.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:11.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:11.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:11.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:11.771+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:11.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:11.867+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:12.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:12.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:12.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:12.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:12.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:12.835+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:13.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:13.619+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:13.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:13.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:13.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:13.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:14.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:14.619+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:14.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:14.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:14.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:14.799+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:15.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:15.655+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:15.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:15.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:15.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:15.827+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:16.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:16.655+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:16.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:16.779+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:16.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:16.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:17.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:17.639+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:17.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:17.779+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:17.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:17.875+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:18.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:18.667+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:18.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:18.771+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:18.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:18.871+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:19.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:19.627+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:19.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:19.747+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:19.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:19.831+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:20.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:20.599+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:20.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:20.703+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:20.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:20.838+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:21.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:21.554+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:21.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:21.662+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:21.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:21.846+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:22.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:22.566+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:22.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:22.654+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:22.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:22.814+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:23.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:23.606+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:23.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:23.702+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:23.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:23.798+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:24.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:24.570+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:24.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:24.714+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:24.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:24.750+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:25.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:25.566+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:25.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:25.670+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:25.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:25.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:26.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:26.598+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:26.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:26.678+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:26.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:26.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:27.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:27.646+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:27.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:27.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:27.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:27.738+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:28.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:28.626+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:28.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:28.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:28.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:28.758+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:29.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:29.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:29.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:29.642+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:29.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:29.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:30.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:30.610+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:30.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:30.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:30.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:30.714+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:31.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:31.578+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:31.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:31.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:31.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:31.670+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:32.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:32.618+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:32.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:32.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:32.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:32.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:33.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:33.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:33.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:33.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:33.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:33.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:34.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:34.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:34.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:34.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:34.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:34.678+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:35.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:35.578+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:35.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:35.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:35.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:35.710+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:36.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:36.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:36.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:36.654+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:36.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:36.726+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:37.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:37.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:37.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:37.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:37.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:37.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:38.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:38.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:38.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:38.722+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:38.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:38.730+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:39.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:39.650+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:39.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:39.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:39.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:39.746+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:40.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:40.686+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:40.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:40.718+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:40.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:40.790+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:41.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:41.682+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:41.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:41.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:41.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:41.834+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:42.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:42.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:42.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:42.694+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:42.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:42.878+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:43.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:43.718+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:43.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:43.734+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:43.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:43.846+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:44.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:44.674+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:44.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:44.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:44.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:44.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:45.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:45.642+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:45.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:45.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:45.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:45.802+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:46.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:46.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:46.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:46.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:46.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:46.838+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:47.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:47.602+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:47.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:47.790+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:47.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:47.838+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:48.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:48.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:48.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:48.802+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:48.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:48.826+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:49.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:49.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:49.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:49.794+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:49.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:49.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:50.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:50.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:50.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:50.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:50.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:50.842+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:51.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:51.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:51.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:51.806+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:51.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:51.810+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:52.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:52.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:52.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:52.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:52.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:52.814+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:53.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:53.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:53.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:53.790+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:53.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:53.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:54.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:54.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:54.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:54.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:54.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:54.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:55.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:55.662+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:55.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:55.714+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:55.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:55.742+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:56.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:56.662+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:56.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:56.718+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:56.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:56.742+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:57.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:57.658+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:57.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:57.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:57.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:57.742+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:58.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:58.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:58.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:58.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:58.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:58.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:59.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:53:59.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:53:59.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:53:59.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:53:59.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:53:59.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:00.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:00.546+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:00.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:00.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:00.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:00.746+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:01.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:01.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:01.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:01.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:01.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:01.714+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:02.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:02.558+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:02.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:02.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:02.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:02.678+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:03.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:03.574+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:03.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:03.594+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:03.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:03.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:04.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:04.546+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:04.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:04.578+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:04.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:04.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:05.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:05.510+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:05.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:05.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:05.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:05.774+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:06.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:06.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:06.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:06.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:06.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:06.774+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:07.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:07.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:07.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:07.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:07.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:07.810+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:08.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:08.562+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:08.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:08.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:08.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:08.790+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:09.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:09.562+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:09.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:09.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:09.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:09.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:10.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:10.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:10.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:10.586+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:10.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:10.798+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:11.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:11.578+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:11.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:11.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:11.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:11.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:12.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:12.597+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:12.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:12.633+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:12.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:12.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:13.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:13.605+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:13.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:13.629+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:13.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:13.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:14.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:14.593+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:14.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:14.593+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:14.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:14.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:15.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:15.577+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:15.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:15.633+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:15.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:15.665+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:16.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:16.565+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:16.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:16.641+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:16.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:16.661+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:17.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:17.525+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:17.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:17.613+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:17.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:17.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:18.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:18.497+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:18.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:18.633+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:18.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:18.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:19.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:19.453+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:19.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:19.605+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:19.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:19.701+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:20.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:20.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:20.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:20.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:20.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:20.713+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:21.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:21.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:21.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:21.593+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:21.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:21.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:22.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:22.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:22.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:22.593+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:22.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:22.705+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:23.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:23.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:23.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:23.625+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:23.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:23.733+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:24.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:24.485+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:24.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:24.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:24.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:24.733+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:25.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:25.497+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:25.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:25.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:25.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:25.777+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:26.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:26.453+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:26.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:26.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:26.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:26.733+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:27.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:27.409+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:27.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:27.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:27.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:27.717+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:28.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:28.365+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:28.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:28.609+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:28.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:28.749+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:29.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:29.377+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:29.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:29.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:29.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:29.789+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:30.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:30.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:30.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:30.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:30.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:30.793+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:31.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:31.377+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:31.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:31.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:31.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:31.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:32.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:32.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:32.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:32.633+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:32.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:32.777+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:33.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:33.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:33.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:33.653+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:33.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:33.805+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:34.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:34.409+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:34.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:34.697+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:34.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:34.773+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:35.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:35.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:35.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:35.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:35.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:35.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:36.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:36.441+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:36.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:36.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:36.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:36.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:37.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:37.401+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:37.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:37.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:37.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:37.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:38.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:38.393+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:38.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:38.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:38.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:38.809+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:39.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:39.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:39.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:39.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:39.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:39.825+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:40.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:40.341+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:40.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:40.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:40.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:40.853+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:41.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:41.309+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:41.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:41.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:41.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:41.897+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:42.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:42.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:42.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:42.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:42.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:42.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:43.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:43.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:43.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:43.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:43.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:43.909+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:44.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:44.217+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:44.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:44.665+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:44.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:44.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:45.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:45.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:45.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:45.629+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:45.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:45.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:46.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:46.201+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:46.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:46.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:46.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:46.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:47.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:47.225+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:47.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:47.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:47.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:47.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:48.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:48.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:48.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:48.645+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:48.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:48.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:49.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:49.237+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:49.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:49.633+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:49.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:49.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:50.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:50.233+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:50.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:50.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:50.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:50.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:51.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:51.237+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:51.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:51.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:51.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:51.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:52.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:52.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:52.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:52.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:52.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:52.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:53.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:53.201+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:53.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:53.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:53.831 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:53.829+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:54.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:54.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:54.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:54.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:54.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:54.869+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:55.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:55.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:55.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:55.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:55.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:55.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:56.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:56.189+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:56.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:56.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:56.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:56.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:57.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:57.241+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:57.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:57.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:57.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:57.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:58.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:58.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:58.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:58.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:58.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:58.937+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:54:59.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:54:59.297+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:59.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:54:59.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:54:59.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:54:59.937+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:00.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:00.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:00.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:00.869+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:00.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:00.981+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:01.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:01.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:01.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:01.845+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:01.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:01.945+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:02.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:02.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:02.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:02.860+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:02.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:02.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:03.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:03.236+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:03.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:03.832+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:03.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:03.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:04.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:04.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:04.843 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:04.840+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:04.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:04.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:05.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:05.216+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:05.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:05.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:05.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:05.872+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:06.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:06.216+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:06.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:06.860+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:06.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:06.884+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:07.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:07.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:07.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:07.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:07.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:07.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:08.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:08.280+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:08.912 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:08.908+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:08.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:08.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:09.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:09.244+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:09.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:09.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:09.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:09.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:10.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:10.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:10.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:10.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:10.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:10.900+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:11.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:11.268+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:11.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:11.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:11.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:11.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:12.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:12.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:12.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:12.828+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:12.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:12.844+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:13.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:13.284+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:13.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:13.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:13.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:13.812+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:14.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:14.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:14.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:14.784+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:14.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:14.796+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:15.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:15.288+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:15.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:15.780+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:15.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:15.812+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:16.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:16.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:16.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:16.800+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:16.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:16.824+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:17.364 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:17.360+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:17.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:17.800+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:17.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:17.816+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:18.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:18.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:18.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:18.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:18.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:18.864+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:19.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:19.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:19.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:19.824+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:19.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:19.872+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:20.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:20.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:20.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:20.780+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:20.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:20.844+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:21.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:21.472+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:21.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:21.772+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:21.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:21.828+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:22.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:22.436+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:22.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:22.796+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:22.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:22.816+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:23.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:23.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:23.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:23.804+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:23.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:23.812+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:24.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:24.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:24.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:24.780+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:24.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:24.808+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:25.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:25.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:25.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:25.800+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:25.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:25.828+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:26.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:26.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:26.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:26.836+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:26.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:26.872+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:27.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:27.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:27.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:27.836+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:27.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:27.920+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:28.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:28.376+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:28.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:28.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:28.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:28.932+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:29.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:29.336+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:29.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:29.820+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:29.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:29.976+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:30.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:30.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:30.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:30.852+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:30.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:30.960+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:31.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:31.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:31.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:31.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:31.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:31.964+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:32.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:32.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:32.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:32.868+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:33.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:33.008+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:33.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:33.364+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:33.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:33.908+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:33.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:33.984+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:34.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:34.348+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:34.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:34.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:35.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:35.032+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:35.350 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:35.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:35.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:35.892+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:36.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:36.008+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:36.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:36.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:36.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:36.868+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:36.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:36.976+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:37.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:37.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:37.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:37.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:37.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:37.972+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:38.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:38.336+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:38.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:38.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:38.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:38.988+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:39.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:39.300+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:39.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:39.908+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:40.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:40.036+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:40.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:40.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:40.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:40.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:41.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:41.080+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:41.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:41.280+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:41.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:41.880+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:42.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:42.048+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:42.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:42.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:42.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:42.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:43.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:43.084+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:43.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:43.272+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:43.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:43.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:44.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:44.120+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:44.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:44.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:44.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:44.944+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:45.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:45.104+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:45.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:45.236+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:45.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:45.944+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:46.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:46.124+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:46.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:46.272+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:46.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:46.960+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:47.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:47.148+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:47.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:47.316+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:47.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:47.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:48.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:48.140+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:48.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:48.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:49.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:49.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:49.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:49.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:49.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:49.288+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:50.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:50.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:50.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:50.148+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:50.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:50.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:51.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:51.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:51.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:51.143+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:51.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:51.259+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:52.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:52.035+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:52.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:52.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:52.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:52.231+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:53.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:52.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:53.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:53.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:53.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:53.235+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:53.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:53.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:54.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:54.187+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:54.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:54.215+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:55.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:55.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:55.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:55.207+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:55.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:55.219+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:56.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:56.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:56.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:56.207+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:56.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:56.239+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:57.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:56.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:57.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:57.215+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:57.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:57.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:58.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:58.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:58.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:58.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:58.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:58.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:58.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:55:58.983+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:55:59.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:55:59.147+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:55:59.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:55:59.259+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:00.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:00.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:00.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:00.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:00.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:00.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:01.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:01.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:01.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:01.175+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:01.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:01.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:01.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:01.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:02.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:02.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:02.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:02.295+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:02.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:02.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:03.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:03.115+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:03.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:03.319+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:03.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:03.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:04.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:04.075+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:04.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:04.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:04.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:04.951+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:05.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:05.055+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:05.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:05.311+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:05.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:05.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:06.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:06.075+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:06.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:06.263+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:07.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:07.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:07.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:07.063+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:07.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:07.255+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:08.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:08.063+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:08.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:08.079+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:08.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:08.215+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:09.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:09.039+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:09.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:09.043+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:09.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:09.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:10.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:09.999+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:10.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:10.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:10.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:10.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:10.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:10.987+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:11.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:11.015+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:11.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:11.247+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:12.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:12.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:12.019 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:12.011+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:12.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:12.287+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:13.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:12.995+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:13.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:13.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:13.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:13.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:13.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:13.975+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:14.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:14.063+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:14.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:14.227+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:14.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:14.963+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:15.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:15.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:15.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:15.223+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:15.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:15.919+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:16.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:16.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:16.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:16.211+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:16.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:16.879+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:17.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:17.059+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:17.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:17.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:17.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:17.863+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:18.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:18.095+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:18.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:18.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:18.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:18.835+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:19.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:19.115+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:19.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:19.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:19.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:19.815+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:20.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:20.083+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:20.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:20.119+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:20.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:20.839+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:21.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:21.091+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:21.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:21.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:21.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:21.855+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:22.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:22.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:22.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:22.079+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:22.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:22.855+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:23.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:23.059+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:23.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:23.119+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:23.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:23.811+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:24.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:24.051+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:24.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:24.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:24.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:24.771+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:25.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:24.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:25.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:25.139+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:25.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:25.815+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:26.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:26.023+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:26.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:26.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:26.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:26.815+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:26.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:26.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:27.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:27.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:27.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:27.791+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:28.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:28.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:28.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:28.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:28.824 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:28.819+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:29.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:28.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:29.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:29.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:29.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:29.799+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:29.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:29.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:30.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:30.167+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:30.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:30.783+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:31.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:31.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:31.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:31.139+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:31.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:31.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:32.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:32.023+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:32.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:32.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:32.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:32.735+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:32.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:32.987+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:33.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:33.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:33.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:33.743+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:34.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:34.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:34.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:34.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:34.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:34.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:34.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:34.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:35.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:35.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:35.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:35.775+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:36.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:35.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:36.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:36.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:36.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:36.755+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:37.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:36.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:37.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:37.215+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:37.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:37.763+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:37.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:37.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:38.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:38.255+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:38.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:38.775+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:38.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:38.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:39.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:39.242+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:39.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:39.822+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:40.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:40.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:40.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:40.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:40.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:40.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:40.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:40.986+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:41.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:41.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:41.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:41.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:41.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:41.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:42.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:42.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:42.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:42.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:43.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:43.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:43.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:43.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:43.860 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:43.854+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:43.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:43.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:44.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:44.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:44.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:44.866+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:44.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:44.962+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:45.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:45.054+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:45.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:45.846+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:45.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:45.982+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:46.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:46.034+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:46.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:46.894+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:46.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:46.986+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:47.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:46.998+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:47.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:47.890+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:47.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:47.954+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:47.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:47.978+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:48.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:48.846+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:48.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:48.946+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:48.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:48.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:49.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:49.802+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:49.943 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:49.938+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:50.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:50.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:50.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:50.798+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:50.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:50.946+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:51.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:50.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:51.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:51.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:51.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:51.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:52.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:51.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:52.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:52.766+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:52.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:52.982+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:53.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:53.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:53.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:53.762+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:53.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:53.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:54.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:54.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:54.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:54.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:55.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:55.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:55.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:55.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:55.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:55.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:55.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:55.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:56.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:56.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:56.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:56.806+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:56.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:56.978+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:57.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:57.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:57.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:57.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:57.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:57.942+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:58.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:58.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:58.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:58.754+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:58.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:58.966+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:59.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:56:59.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:56:59.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:56:59.742+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:56:59.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:56:59.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:00.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:00.034+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:00.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:00.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:00.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:00.942+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:01.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:01.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:01.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:01.710+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:01.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:01.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:02.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:02.074+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:02.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:02.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:02.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:02.942+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:03.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:03.118+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:03.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:03.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:03.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:03.934+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:04.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:04.150+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:04.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:04.626+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:04.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:04.918+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:05.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:05.166+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:05.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:05.642+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:05.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:05.882+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:06.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:06.186+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:06.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:06.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:06.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:06.846+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:07.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:07.230+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:07.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:07.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:07.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:07.854+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:08.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:08.274+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:08.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:08.638+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:08.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:08.850+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:09.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:09.306+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:09.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:09.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:09.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:09.882+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:10.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:10.266+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:10.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:10.630+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:10.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:10.918+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:11.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:11.290+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:11.663 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:11.658+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:11.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:11.878+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:12.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:12.262+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:12.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:12.650+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:12.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:12.878+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:13.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:13.298+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:13.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:13.662+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:13.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:13.838+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:14.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:14.338+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:14.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:14.618+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:14.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:14.874+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:15.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:15.290+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:15.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:15.606+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:15.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:15.918+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:16.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:16.294+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:16.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:16.566+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:16.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:16.950+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:17.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:17.322+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:17.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:17.594+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:18.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:18.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:18.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:18.342+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:18.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:18.606+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:18.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:18.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:19.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:19.358+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:19.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:19.622+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:19.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:19.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:20.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:20.362+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:20.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:20.630+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:20.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:20.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:21.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:21.346+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:21.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:21.654+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:21.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:21.982+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:22.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:22.350+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:22.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:22.678+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:22.979 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:22.974+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:23.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:23.346+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:23.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:23.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:23.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:23.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:24.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:24.386+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:24.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:24.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:24.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:24.990+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:25.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:25.414+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:25.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:25.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:25.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:25.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:26.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:26.366+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:26.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:26.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:26.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:26.953+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:27.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:27.361+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:27.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:27.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:27.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:27.985+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:28.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:28.349+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:28.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:28.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:29.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:29.017+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:29.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:29.325+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:29.681 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:29.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:30.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:30.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:30.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:30.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:30.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:30.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:31.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:31.077+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:31.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:31.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:31.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:31.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:32.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:32.089+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:32.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:32.389+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:32.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:32.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:33.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:33.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:33.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:33.377+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:33.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:33.745+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:34.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:34.189+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:34.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:34.397+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:34.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:34.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:35.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:35.205+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:35.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:35.381+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:35.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:35.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:36.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:36.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:36.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:36.357+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:36.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:36.853+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:37.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:37.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:37.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:37.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:37.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:37.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:38.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:38.341+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:38.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:38.389+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:38.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:38.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:39.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:39.349+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:39.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:39.385+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:39.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:39.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:40.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:40.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:40.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:40.373+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:40.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:40.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:41.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:41.337+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:41.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:41.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:41.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:41.801+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:42.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:42.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:42.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:42.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:42.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:42.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:43.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:43.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:43.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:43.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:43.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:43.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:44.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:44.289+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:44.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:44.361+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:44.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:44.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:45.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:45.285+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:45.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:45.401+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:45.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:45.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:46.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:46.325+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:46.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:46.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:46.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:46.841+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:47.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:47.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:47.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:47.341+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:47.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:47.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:48.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:48.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:48.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:48.305+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:48.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:48.941+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:49.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:49.293+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:49.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:49.329+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:49.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:49.909+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:50.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:50.317+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:50.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:50.377+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:50.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:50.941+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:51.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:51.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:51.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:51.361+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:51.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:51.969+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:52.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:52.321+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:52.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:52.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:52.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:52.929+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:53.291 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:53.289+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:53.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:53.329+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:53.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:53.973+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:54.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:54.293+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:54.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:54.317+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:54.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:54.985+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:55.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:55.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:55.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:55.317+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:56.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:56.021+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:56.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:56.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:56.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:56.361+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:57.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:57.073+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:57.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:57.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:57.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:57.321+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:58.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:58.057+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:58.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:58.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:58.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:58.349+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:57:59.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:57:59.077+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:59.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:57:59.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:57:59.344 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:57:59.341+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:00.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:00.121+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:00.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:00.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:00.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:00.365+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:01.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:01.141+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:01.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:01.281+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:01.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:01.377+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:02.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:02.129+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:02.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:02.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:02.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:02.349+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:03.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:03.177+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:03.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:03.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:03.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:03.309+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:04.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:04.133+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:04.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:04.233+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:04.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:04.269+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:05.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:05.085+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:05.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:05.193+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:05.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:05.277+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:06.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:06.057+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:06.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:06.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:06.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:06.301+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:07.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:07.073+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:07.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:07.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:07.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:07.333+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:08.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:08.069+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:08.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:08.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:08.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:08.353+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:09.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:09.081+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:09.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:09.129+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:09.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:09.321+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:10.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:10.073+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:10.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:10.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:10.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:10.277+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:11.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:11.117+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:11.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:11.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:11.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:11.277+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:12.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:12.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:12.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:12.145+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:12.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:12.321+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:13.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:13.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:13.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:13.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:13.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:13.341+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:14.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:14.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:14.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:14.176+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:14.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:14.316+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:15.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:15.112+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:15.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:15.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:15.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:15.300+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:16.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:16.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:16.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:16.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:16.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:16.308+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:17.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:17.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:17.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:17.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:17.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:17.344+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:18.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:18.148+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:18.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:18.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:18.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:18.360+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:19.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:19.112+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:19.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:19.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:19.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:19.396+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:20.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:20.144+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:20.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:20.160+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:20.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:20.360+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:21.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:21.136+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:21.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:21.140+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:21.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:21.344+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:22.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:22.100+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:22.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:22.188+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:22.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:22.340+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:23.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:23.052+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:23.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:23.224+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:23.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:23.292+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:24.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:24.076+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:24.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:24.228+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:24.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:24.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:25.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:25.040+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:25.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:25.264+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:25.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:25.368+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:26.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:26.040+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:26.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:26.236+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:26.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:26.396+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:27.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:27.072+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:27.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:27.208+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:27.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:27.432+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:28.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:28.108+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:28.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:28.248+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:28.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:28.448+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:29.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:29.092+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:29.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:29.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:29.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:29.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:30.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:30.104+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:30.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:30.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:30.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:30.456+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:31.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:31.144+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:31.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:31.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:31.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:31.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:32.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:32.176+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:32.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:32.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:32.427 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:32.424+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:33.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:33.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:33.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:33.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:33.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:33.408+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:34.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:34.128+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:34.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:34.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:34.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:34.388+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:35.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:35.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:35.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:35.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:35.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:35.360+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:36.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:36.212+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:36.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:36.312+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:36.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:36.400+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:37.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:37.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:37.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:37.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:37.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:37.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:38.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:38.240+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:38.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:38.364+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:38.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:38.388+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:39.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:39.236+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:39.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:39.364+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:39.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:39.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:40.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:40.196+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:40.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:40.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:40.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:40.408+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:41.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:41.208+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:41.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:41.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:41.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:41.452+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:42.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:42.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:42.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:42.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:42.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:42.484+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:43.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:43.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:43.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:43.308+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:43.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:43.452+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:44.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:44.236+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:44.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:44.284+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:44.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:44.432+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:45.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:45.216+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:45.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:45.284+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:45.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:45.412+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:46.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:46.220+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:46.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:46.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:46.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:46.376+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:47.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:47.216+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:47.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:47.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:47.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:47.332+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:48.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:48.212+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:48.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:48.248+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:48.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:48.292+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:49.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:49.248+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:49.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:49.256+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:49.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:49.304+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:50.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:50.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:50.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:50.272+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:50.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:50.332+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:51.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:51.228+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:51.285 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:51.280+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:51.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:51.340+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:52.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:52.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:52.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:52.296+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:52.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:52.360+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:53.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:53.284+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:53.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:53.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:53.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:53.396+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:54.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:54.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:54.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:54.312+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:54.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:54.444+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:55.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:55.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:55.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:55.336+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:55.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:55.440+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:56.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:56.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:56.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:56.312+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:56.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:56.460+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:57.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:57.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:57.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:57.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:57.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:57.492+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:58.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:58.272+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:58.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:58.324+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:58.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:58.468+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:58:59.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:58:59.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:59.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:58:59.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:58:59.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:58:59.488+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:00.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:00.307+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:00.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:00.315+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:00.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:00.451+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:01.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:01.335+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:01.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:01.347+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:01.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:01.475+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:02.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:02.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:02.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:02.395+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:02.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:02.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:03.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:03.347+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:03.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:03.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:03.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:03.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:04.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:04.299+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:04.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:04.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:04.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:04.383+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:05.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:05.263+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:05.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:05.311+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:05.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:05.383+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:06.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:06.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:06.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:06.295+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:06.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:06.363+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:07.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:07.227+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:07.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:07.287+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:07.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:07.371+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:08.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:08.255+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:08.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:08.307+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:08.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:08.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:09.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:09.275+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:09.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:09.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:09.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:09.387+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:10.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:10.255+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:10.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:10.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:10.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:10.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:11.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:11.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:11.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:11.307+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:11.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:11.455+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:12.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:12.219+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:12.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:12.279+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:12.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:12.471+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:13.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:13.267+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:13.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:13.331+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:13.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:13.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:14.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:14.227+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:14.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:14.371+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:14.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:14.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:15.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:15.187+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:15.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:15.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:15.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:15.559+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:16.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:16.199+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:16.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:16.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:16.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:16.551+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:17.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:17.155+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:17.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:17.371+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:17.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:17.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:18.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:18.203+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:18.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:18.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:18.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:18.607+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:19.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:19.243+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:19.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:19.423+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:19.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:19.575+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:20.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:20.239+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:20.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:20.391+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:20.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:20.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:21.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:21.263+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:21.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:21.363+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:21.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:21.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:22.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:22.235+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:22.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:22.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:22.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:22.615+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:23.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:23.271+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:23.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:23.395+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:23.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:23.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:24.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:24.291+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:24.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:24.431+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:24.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:24.563+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:25.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:25.275+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:25.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:25.391+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:25.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:25.603+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:26.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:26.255+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:26.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:26.375+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:26.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:26.647+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:27.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:27.259+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:27.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:27.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:27.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:27.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:28.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:28.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:28.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:28.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:28.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:28.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:29.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:29.319+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:29.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:29.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:29.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:29.635+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:30.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:30.343+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:30.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:30.367+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:30.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:30.607+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:31.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:31.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:31.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:31.391+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:31.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:31.563+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:32.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:32.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:32.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:32.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:32.519 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:32.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:33.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:33.343+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:33.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:33.431+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:33.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:33.555+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:34.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:34.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:34.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:34.439+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:34.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:34.583+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:35.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:35.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:35.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:35.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:35.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:35.607+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:36.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:36.399+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:36.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:36.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:36.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:36.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:37.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:37.399+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:37.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:37.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:37.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:37.631+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:38.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:38.387+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:38.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:38.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:38.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:38.587+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:39.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:39.371+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:39.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:39.387+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:39.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:39.627+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:40.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:40.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:40.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:40.395+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:40.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:40.659+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:41.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:41.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:41.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:41.387+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:41.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:41.671+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:42.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:42.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:42.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:42.431+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:42.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:42.703+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:43.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:43.359+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:43.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:43.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:43.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:43.739+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:44.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:44.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:44.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:44.455+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:44.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:44.715+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:45.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:45.367+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:45.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:45.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:45.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:45.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:46.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:46.410+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:46.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:46.502+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:46.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:46.802+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:47.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:47.374+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:47.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:47.550+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:47.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:47.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:48.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:48.406+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:48.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:48.534+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:48.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:48.778+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:49.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:49.386+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:49.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:49.514+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:49.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:49.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:50.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:50.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:50.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:50.510+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:50.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:50.774+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:51.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:51.302+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:51.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:51.526+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:51.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:51.806+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:52.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:52.270+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:52.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:52.514+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:52.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:52.830+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:53.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:53.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:53.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:53.550+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:53.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:53.882+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:54.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:54.294+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:54.595 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:54.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:54.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:54.870+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:55.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:55.330+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:55.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:55.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:55.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:55.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:56.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:56.298+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:56.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:56.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:56.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:56.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:57.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:57.346+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:57.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:57.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:57.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:57.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:58.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:58.378+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:58.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:58.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:58.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:58.962+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T16:59:59.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T16:59:59.422+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:59.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T16:59:59.682+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T16:59:59.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T16:59:59.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:00.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:00.454+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:00.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:00.718+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:00.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:00.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:01.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:01.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:01.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:01.750+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:01.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:01.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:02.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:02.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:02.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:02.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:02.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:02.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:03.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:03.446+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:03.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:03.682+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:03.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:03.982+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:04.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:04.442+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:04.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:04.662+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:05.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:04.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:05.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:05.466+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:05.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:05.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:06.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:06.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:06.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:06.450+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:06.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:06.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:07.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:07.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:07.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:07.438+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:07.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:07.674+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:07.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:07.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:08.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:08.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:08.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:08.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:09.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:08.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:09.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:09.434+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:09.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:09.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:10.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:10.042+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:10.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:10.474+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:10.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:10.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:11.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:10.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:11.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:11.506+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:11.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:11.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:12.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:12.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:12.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:12.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:12.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:12.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:12.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:12.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:13.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:13.454+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:13.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:13.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:14.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:14.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:14.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:14.470+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:14.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:14.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:15.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:15.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:15.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:15.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:15.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:15.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:16.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:16.098+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:16.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:16.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:16.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:16.622+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:17.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:17.074+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:17.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:17.378+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:17.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:17.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:18.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:18.074+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:18.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:18.346+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:18.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:18.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:19.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:19.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:19.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:19.390+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:19.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:19.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:20.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:20.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:20.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:20.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:20.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:20.602+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:21.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:21.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:21.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:21.434+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:21.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:21.586+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:22.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:22.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:22.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:22.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:22.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:22.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:23.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:23.118+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:23.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:23.354+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:23.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:23.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:24.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:24.146+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:24.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:24.334+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:24.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:24.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:25.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:25.190+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:25.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:25.378+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:25.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:25.522+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:26.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:26.186+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:26.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:26.334+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:26.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:26.518+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:27.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:27.158+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:27.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:27.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:27.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:27.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:28.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:28.190+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:28.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:28.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:28.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:28.574+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:29.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:29.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:29.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:29.334+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:29.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:29.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:30.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:30.202+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:30.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:30.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:30.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:30.574+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:31.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:31.230+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:31.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:31.394+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:31.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:31.538+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:32.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:32.254+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:32.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:32.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:32.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:32.585+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:33.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:33.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:33.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:33.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:33.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:33.597+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:34.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:34.193+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:34.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:34.453+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:34.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:34.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:35.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:35.233+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:35.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:35.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:35.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:35.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:36.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:36.209+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:36.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:36.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:36.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:36.625+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:37.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:37.181+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:37.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:37.441+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:37.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:37.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:38.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:38.197+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:38.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:38.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:38.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:38.661+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:39.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:39.225+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:39.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:39.505+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:39.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:39.693+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:40.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:40.261+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:40.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:40.513+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:40.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:40.677+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:41.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:41.293+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:41.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:41.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:41.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:41.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:42.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:42.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:42.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:42.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:42.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:42.705+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:43.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:43.293+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:43.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:43.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:43.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:43.753+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:44.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:44.265+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:44.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:44.589+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:44.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:44.753+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:45.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:45.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:45.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:45.609+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:45.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:45.721+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:46.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:46.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:46.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:46.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:46.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:46.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:47.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:47.177+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:47.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:47.605+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:47.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:47.749+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:48.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:48.213+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:48.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:48.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:48.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:48.773+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:49.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:49.241+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:49.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:49.673+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:49.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:49.745+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:50.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:50.213+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:50.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:50.653+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:50.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:50.761+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:51.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:51.209+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:51.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:51.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:51.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:51.793+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:52.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:52.217+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:52.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:52.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:52.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:52.801+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:53.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:53.257+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:53.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:53.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:53.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:53.809+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:54.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:54.217+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:54.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:54.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:54.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:54.849+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:55.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:55.193+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:55.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:55.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:55.860 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:55.857+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:56.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:56.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:56.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:56.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:56.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:56.897+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:57.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:57.197+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:57.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:57.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:57.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:57.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:58.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:58.165+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:58.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:58.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:58.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:58.973+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:59.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:00:59.149+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:00:59.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:00:59.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:00:59.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:00:59.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:00.176 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:00.173+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:00.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:00.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:00.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:00.973+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:01.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:01.133+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:01.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:01.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:01.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:01.985+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:02.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:02.137+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:02.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:02.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:03.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:02.997+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:03.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:03.101+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:03.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:03.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:04.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:04.033+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:04.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:04.133+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:04.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:04.785+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:05.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:05.017+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:05.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:05.113+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:05.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:05.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:05.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:05.977+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:06.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:06.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:06.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:06.745+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:06.945 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:06.941+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:07.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:07.165+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:07.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:07.721+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:07.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:07.937+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:08.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:08.209+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:08.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:08.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:08.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:08.965+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:09.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:09.193+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:09.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:09.769+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:09.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:09.973+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:10.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:10.169+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:10.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:10.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:10.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:10.941+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:11.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:11.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:11.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:11.721+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:11.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:11.965+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:12.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:12.205+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:12.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:12.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:13.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:13.013+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:13.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:13.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:13.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:13.721+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:14.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:14.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:14.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:14.225+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:14.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:14.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:15.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:15.093+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:15.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:15.241+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:15.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:15.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:16.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:16.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:16.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:16.205+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:16.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:16.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:17.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:17.121+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:17.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:17.233+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:17.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:17.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:18.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:18.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:18.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:18.236+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:18.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:18.724+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:19.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:19.128+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:19.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:19.208+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:19.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:19.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:20.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:20.088+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:20.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:20.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:20.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:20.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:21.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:21.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:21.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:21.124+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:21.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:21.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:22.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:22.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:22.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:22.140+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:22.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:22.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:22.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:22.960+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:23.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:23.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:23.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:23.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:23.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:23.972+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:24.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:24.072+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:24.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:24.676+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:24.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:24.952+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:25.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:25.076+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:25.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:25.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:25.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:25.964+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:26.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:26.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:26.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:26.676+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:26.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:26.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:27.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:27.044+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:27.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:27.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:27.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:27.948+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:28.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:28.068+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:28.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:28.652+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:28.994 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:28.988+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:29.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:29.048+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:29.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:29.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:29.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:29.988+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:30.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:30.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:30.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:30.712+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:30.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:30.968+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:31.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:31.040+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:31.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:31.716+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:31.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:31.984+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:32.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:32.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:32.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:32.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:32.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:32.972+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:33.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:33.096+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:33.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:33.724+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:33.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:33.952+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:34.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:34.068+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:34.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:34.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:34.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:34.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:35.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:35.024+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:35.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:35.684+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:35.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:35.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:36.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:36.012+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:36.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:36.684+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:36.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:36.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:37.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:37.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:37.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:37.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:37.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:37.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:38.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:38.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:38.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:38.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:38.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:38.920+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:39.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:39.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:39.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:39.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:39.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:39.972+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:40.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:40.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:40.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:40.732+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:41.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:41.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:41.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:41.080+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:41.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:41.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:42.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:42.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:42.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:42.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:42.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:42.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:42.996 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:42.992+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:43.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:43.068+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:43.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:43.732+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:44.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:44.016+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:44.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:44.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:44.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:44.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:45.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:45.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:45.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:45.032+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:45.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:45.800+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:45.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:45.988+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:46.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:46.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:46.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:46.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:46.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:46.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:47.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:47.024+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:47.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:47.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:47.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:47.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:47.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:47.996+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:48.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:48.784+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:48.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:48.976+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:49.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:49.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:49.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:49.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:50.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:50.016+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:50.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:50.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:50.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:50.780+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:51.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:51.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:51.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:51.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:51.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:51.816+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:51.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:51.960+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:52.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:52.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:52.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:52.848+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:53.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:52.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:53.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:53.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:53.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:53.832+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:53.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:53.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:54.024 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:54.020+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:54.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:54.800+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:54.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:54.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:55.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:55.028+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:55.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:55.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:55.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:55.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:56.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:56.020+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:56.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:56.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:56.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:56.988+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:57.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:56.996+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:57.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:57.792+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:58.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:58.012+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:58.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:58.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:58.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:58.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:58.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:01:58.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:01:59.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:01:59.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:01:59.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:01:59.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:00.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:00.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:00.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:00.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:00.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:00.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:01.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:01.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:01.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:01.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:01.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:01.748+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:02.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:02.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:02.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:02.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:02.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:02.760+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:02.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:02.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:03.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:03.076+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:03.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:03.759+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:03.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:03.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:04.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:04.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:04.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:04.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:04.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:04.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:05.123 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:05.119+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:05.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:05.751+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:05.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:05.931+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:06.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:06.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:06.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:06.719+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:06.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:06.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:07.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:07.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:07.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:07.715+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:07.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:07.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:08.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:08.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:08.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:08.723+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:09.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:09.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:09.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:09.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:09.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:09.723+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:10.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:09.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:10.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:10.107+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:10.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:10.743+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:11.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:11.035+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:11.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:11.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:11.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:11.699+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:12.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:12.027+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:12.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:12.191+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:12.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:12.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:13.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:13.015+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:13.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:13.151+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:13.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:13.779+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:14.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:14.043+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:14.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:14.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:14.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:14.799+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:15.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:15.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:15.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:15.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:15.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:15.799+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:15.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:15.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:16.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:16.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:16.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:16.811+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:17.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:17.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:17.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:17.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:17.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:17.851+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:17.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:17.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:18.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:18.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:18.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:18.831+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:18.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:18.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:19.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:19.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:19.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:19.791+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:19.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:19.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:20.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:20.179+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:20.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:20.799+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:20.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:20.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:21.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:21.203+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:21.830 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:21.823+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:21.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:21.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:22.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:22.183+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:22.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:22.847+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:23.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:23.015+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:23.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:23.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:23.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:23.819+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:24.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:23.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:24.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:24.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:24.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:24.771+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:24.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:24.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:25.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:25.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:25.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:25.791+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:25.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:25.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:26.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:26.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:26.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:26.779+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:26.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:26.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:27.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:27.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:27.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:27.743+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:27.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:27.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:28.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:28.175+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:28.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:28.719+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:28.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:28.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:29.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:29.203+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:29.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:29.671+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:29.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:29.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:30.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:30.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:30.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:30.711+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:30.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:30.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:31.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:31.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:31.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:31.739+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:31.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:31.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:32.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:32.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:32.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:32.787+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:32.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:32.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:33.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:33.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:33.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:33.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:33.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:33.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:34.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:34.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:34.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:34.731+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:34.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:34.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:35.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:35.115+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:35.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:35.715+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:35.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:35.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:36.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:36.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:36.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:36.759+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:36.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:36.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:37.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:37.119+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:37.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:37.743+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:37.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:37.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:38.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:38.151+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:38.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:38.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:38.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:38.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:39.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:39.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:39.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:39.735+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:39.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:39.879+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:40.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:40.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:40.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:40.687+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:40.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:40.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:41.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:41.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:41.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:41.675+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:41.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:41.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:42.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:42.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:42.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:42.703+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:42.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:42.815+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:43.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:43.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:43.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:43.731+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:43.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:43.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:44.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:44.083+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:44.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:44.747+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:44.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:44.771+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:45.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:45.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:45.790 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:45.783+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:45.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:45.819+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:46.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:46.075+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:46.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:46.783+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:46.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:46.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:47.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:47.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:47.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:47.803+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:47.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:47.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:48.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:48.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:48.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:48.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:48.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:48.847+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:49.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:49.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:49.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:49.782+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:49.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:49.886+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:50.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:50.078+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:50.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:50.774+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:50.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:50.894+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:51.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:51.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:51.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:51.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:51.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:51.902+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:52.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:52.126+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:52.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:52.710+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:52.860 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:52.854+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:53.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:53.082+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:53.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:53.678+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:53.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:53.874+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:54.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:54.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:54.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:54.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:54.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:54.878+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:55.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:55.078+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:55.727 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:55.722+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:55.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:55.842+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:56.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:56.110+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:56.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:56.742+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:56.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:56.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:57.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:57.090+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:57.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:57.746+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:57.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:57.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:58.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:58.102+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:58.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:58.762+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:58.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:58.770+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:59.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:02:59.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:02:59.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:02:59.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:02:59.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:02:59.770+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:00.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:00.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:00.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:00.746+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:00.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:00.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:01.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:01.146+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:01.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:01.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:01.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:01.738+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:02.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:02.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:02.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:02.758+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:02.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:02.762+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:03.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:03.098+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:03.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:03.746+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:03.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:03.810+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:04.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:04.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:04.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:04.790+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:04.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:04.834+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:05.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:05.026+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:05.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:05.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:05.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:05.842+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:06.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:06.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:06.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:06.734+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:06.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:06.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:07.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:07.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:07.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:07.750+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:07.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:07.810+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:08.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:08.090+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:08.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:08.718+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:08.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:08.766+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:09.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:09.042+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:09.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:09.746+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:09.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:09.750+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:10.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:10.014+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:10.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:10.726+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:10.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:10.734+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:11.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:10.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:11.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:11.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:11.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:11.762+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:11.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:11.978+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:12.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:12.666+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:12.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:12.738+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:13.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:12.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:13.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:13.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:13.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:13.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:13.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:13.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:14.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:14.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:14.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:14.726+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:14.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:14.990+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:15.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:15.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:15.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:15.694+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:15.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:15.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:16.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:16.594+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:16.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:16.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:17.035 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:17.030+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:17.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:17.626+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:17.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:17.734+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:18.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:18.038+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:18.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:18.630+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:18.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:18.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:19.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:19.042+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:19.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:19.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:19.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:19.682+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:20.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:20.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:20.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:20.546+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:20.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:20.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:20.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:20.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:21.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:21.518+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:21.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:21.662+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:21.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:21.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:22.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:22.546+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:22.663 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:22.658+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:22.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:22.934+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:23.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:23.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:23.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:23.694+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:23.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:23.974+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:24.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:24.574+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:24.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:24.706+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:25.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:25.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:25.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:25.574+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:25.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:25.666+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:26.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:26.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:26.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:26.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:26.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:26.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:27.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:27.014+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:27.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:27.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:27.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:27.678+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:27.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:27.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:28.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:28.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:28.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:28.702+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:28.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:28.982+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:29.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:29.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:29.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:29.730+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:30.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:30.030+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:30.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:30.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:30.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:30.702+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:31.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:31.026+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:31.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:31.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:31.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:31.702+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:32.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:32.026+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:32.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:32.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:32.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:32.702+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:33.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:33.054+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:33.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:33.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:33.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:33.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:34.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:34.098+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:34.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:34.553+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:34.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:34.693+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:35.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:35.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:35.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:35.581+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:35.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:35.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:36.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:36.157+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:36.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:36.589+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:36.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:36.665+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:37.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:37.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:37.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:37.617+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:37.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:37.693+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:38.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:38.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:38.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:38.597+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:38.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:38.721+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:39.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:39.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:39.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:39.581+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:39.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:39.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:40.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:40.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:40.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:40.557+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:40.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:40.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:41.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:41.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:41.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:41.545+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:41.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:41.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:42.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:42.137+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:42.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:42.537+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:42.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:42.697+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:43.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:43.109+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:43.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:43.581+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:43.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:43.661+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:44.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:44.157+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:44.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:44.629+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:44.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:44.661+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:45.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:45.161+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:45.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:45.637+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:45.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:45.653+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:46.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:46.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:46.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:46.661+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:46.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:46.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:47.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:47.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:47.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:47.617+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:47.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:47.685+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:48.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:48.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:48.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:48.601+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:48.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:48.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:49.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:49.157+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:49.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:49.625+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:49.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:49.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:50.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:50.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:50.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:50.625+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:50.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:50.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:51.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:51.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:51.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:51.609+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:51.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:51.717+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:52.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:52.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:52.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:52.593+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:52.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:52.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:53.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:53.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:53.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:53.569+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:53.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:53.665+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:54.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:54.229+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:54.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:54.533+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:54.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:54.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:55.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:55.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:55.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:55.509+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:55.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:55.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:56.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:56.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:56.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:56.473+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:56.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:56.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:57.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:57.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:57.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:57.433+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:57.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:57.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:58.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:58.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:58.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:58.429+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:58.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:58.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:59.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:03:59.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:03:59.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:03:59.429+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:03:59.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:03:59.697+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:00.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:00.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:00.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:00.433+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:00.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:00.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:01.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:01.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:01.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:01.389+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:01.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:01.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:02.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:02.229+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:02.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:02.397+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:02.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:02.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:03.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:03.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:03.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:03.365+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:03.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:03.817+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:04.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:04.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:04.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:04.369+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:04.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:04.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:05.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:05.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:05.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:05.381+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:05.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:05.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:06.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:06.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:06.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:06.337+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:06.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:06.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:07.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:07.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:07.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:07.325+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:07.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:07.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:08.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:08.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:08.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:08.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:08.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:08.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:09.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:09.309+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:09.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:09.369+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:09.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:09.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:10.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:10.337+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:10.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:10.409+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:10.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:10.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:11.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:11.293+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:11.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:11.409+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:11.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:11.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:12.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:12.333+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:12.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:12.405+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:12.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:12.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:13.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:13.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:13.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:13.425+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:13.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:13.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:14.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:14.341+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:14.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:14.401+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:14.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:14.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:15.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:15.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:15.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:15.381+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:15.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:15.717+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:16.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:16.385+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:16.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:16.425+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:16.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:16.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:17.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:17.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:17.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:17.473+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:17.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:17.641+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:18.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:18.369+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:18.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:18.505+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:18.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:18.629+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:19.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:19.373+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:19.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:19.533+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:19.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:19.629+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:20.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:20.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:20.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:20.548+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:20.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:20.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:21.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:21.336+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:21.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:21.576+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:21.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:21.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:22.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:22.352+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:22.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:22.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:22.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:22.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:23.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:23.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:23.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:23.544+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:23.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:23.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:24.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:24.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:24.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:24.568+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:24.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:24.600+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:25.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:25.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:25.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:25.556+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:25.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:25.612+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:26.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:26.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:26.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:26.568+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:26.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:26.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:27.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:27.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:27.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:27.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:27.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:27.596+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:28.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:28.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:28.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:28.596+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:28.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:28.632+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:29.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:29.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:29.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:29.592+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:29.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:29.600+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:30.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:30.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:30.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:30.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:30.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:30.636+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:31.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:31.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:31.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:31.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:31.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:31.596+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:32.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:32.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:32.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:32.564+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:32.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:32.568+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:33.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:33.396+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:33.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:33.548+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:33.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:33.548+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:34.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:34.376+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:34.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:34.524+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:34.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:34.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:35.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:35.360+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:35.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:35.504+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:35.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:35.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:36.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:36.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:36.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:36.520+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:36.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:36.552+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:37.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:37.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:37.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:37.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:37.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:37.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:38.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:38.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:38.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:38.552+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:38.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:38.636+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:39.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:39.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:39.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:39.556+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:39.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:39.676+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:40.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:40.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:40.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:40.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:40.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:40.664+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:41.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:41.480+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:41.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:41.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:41.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:41.644+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:42.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:42.484+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:42.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:42.568+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:42.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:42.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:43.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:43.492+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:43.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:43.552+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:43.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:43.612+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:44.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:44.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:44.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:44.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:44.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:44.584+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:45.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:45.440+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:45.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:45.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:45.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:45.616+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:46.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:46.440+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:46.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:46.516+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:46.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:46.648+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:47.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:47.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:47.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:47.516+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:47.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:47.648+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:48.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:48.416+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:48.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:48.508+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:48.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:48.616+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:49.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:49.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:49.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:49.472+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:49.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:49.632+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:50.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:50.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:50.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:50.504+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:50.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:50.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:51.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:51.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:51.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:51.496+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:51.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:51.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:52.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:52.468+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:52.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:52.496+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:52.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:52.700+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:53.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:53.484+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:53.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:53.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:53.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:53.688+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:54.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:54.452+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:54.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:54.508+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:54.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:54.692+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:55.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:55.416+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:55.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:55.476+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:55.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:55.676+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:56.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:56.464+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:56.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:56.508+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:56.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:56.644+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:57.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:57.436+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:57.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:57.468+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:57.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:57.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:58.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:58.412+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:58.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:58.504+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:58.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:58.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:04:59.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:04:59.392+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:59.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:04:59.524+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:04:59.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:04:59.576+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:00.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:00.356+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:00.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:00.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:00.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:00.604+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:01.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:01.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:01.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:01.556+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:01.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:01.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:02.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:02.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:02.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:02.588+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:02.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:02.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:03.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:03.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:03.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:03.592+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:03.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:03.600+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:04.452 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:04.448+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:04.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:04.608+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:04.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:04.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:05.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:05.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:05.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:05.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:05.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:05.603+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:06.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:06.471+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:06.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:06.555+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:06.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:06.619+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:07.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:07.507+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:07.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:07.511+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:07.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:07.663+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:08.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:08.475+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:08.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:08.495+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:08.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:08.671+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:09.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:09.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:09.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:09.483+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:09.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:09.711+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:10.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:10.443+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:10.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:10.491+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:10.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:10.679+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:11.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:11.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:11.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:11.467+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:11.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:11.715+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:12.446 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:12.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:12.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:12.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:12.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:12.751+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:13.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:13.471+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:13.485 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:13.479+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:13.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:13.747+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:14.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:14.443+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:14.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:14.523+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:14.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:14.771+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:15.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:15.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:15.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:15.551+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:15.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:15.791+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:16.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:16.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:16.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:16.595+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:16.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:16.815+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:17.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:17.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:17.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:17.575+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:17.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:17.783+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:18.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:18.431+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:18.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:18.543+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:18.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:18.767+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:19.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:19.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:19.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:19.503+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:19.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:19.747+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:20.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:20.423+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:20.519 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:20.515+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:20.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:20.707+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:21.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:21.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:21.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:21.471+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:21.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:21.703+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:22.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:22.419+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:22.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:22.435+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:22.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:22.699+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:23.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:23.427+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:23.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:23.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:23.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:23.743+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:24.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:24.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:24.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:24.455+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:24.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:24.771+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:25.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:25.395+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:25.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:25.423+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:25.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:25.815+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:26.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:26.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:26.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:26.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:26.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:26.847+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:27.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:27.403+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:27.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:27.427+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:27.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:27.847+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:28.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:28.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:28.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:28.463+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:28.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:28.875+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:29.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:29.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:29.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:29.479+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:29.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:29.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:30.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:30.367+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:30.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:30.507+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:30.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:30.887+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:31.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:31.379+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:31.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:31.539+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:31.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:31.907+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:32.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:32.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:32.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:32.559+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:32.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:32.891+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:33.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:33.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:33.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:33.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:33.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:33.915+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:34.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:34.395+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:34.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:34.547+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:34.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:34.923+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:35.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:35.351+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:35.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:35.559+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:35.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:35.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:36.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:36.323+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:36.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:36.607+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:37.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:37.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:37.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:37.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:37.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:37.583+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:38.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:38.019+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:38.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:38.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:38.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:38.587+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:39.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:39.051+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:39.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:39.407+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:39.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:39.611+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:40.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:40.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:40.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:40.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:40.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:40.579+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:41.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:41.039+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:41.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:41.471+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:41.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:41.579+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:42.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:42.079+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:42.452 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:42.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:42.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:42.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:43.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:43.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:43.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:43.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:43.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:43.583+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:44.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:44.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:44.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:44.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:44.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:44.623+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:45.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:45.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:45.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:45.431+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:45.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:45.579+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:46.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:46.071+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:46.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:46.475+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:46.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:46.539+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:47.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:47.035+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:47.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:47.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:47.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:47.587+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:48.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:48.039+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:48.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:48.475+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:48.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:48.611+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:49.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:49.015+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:49.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:49.507+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:49.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:49.611+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:49.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:49.986+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:50.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:50.478+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:50.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:50.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:51.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:51.022+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:51.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:51.458+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:51.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:51.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:52.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:52.070+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:52.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:52.494+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:52.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:52.662+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:53.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:53.078+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:53.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:53.462+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:53.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:53.630+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:54.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:54.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:54.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:54.466+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:54.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:54.658+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:55.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:55.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:55.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:55.494+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:55.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:55.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:56.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:56.034+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:56.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:56.522+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:56.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:56.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:57.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:57.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:57.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:57.522+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:57.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:57.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:57.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:57.974+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:58.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:58.570+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:58.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:58.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:58.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:58.986+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:59.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:05:59.530+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:05:59.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:05:59.670+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:05:59.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:05:59.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:00.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:00.486+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:00.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:00.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:00.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:00.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:01.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:01.498+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:01.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:01.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:01.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:01.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:02.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:02.514+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:02.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:02.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:03.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:03.010+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:03.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:03.506+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:03.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:03.666+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:04.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:04.010+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:04.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:04.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:04.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:04.658+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:05.029 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:05.022+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:05.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:05.538+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:05.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:05.654+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:06.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:06.054+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:06.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:06.582+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:06.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:06.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:07.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:07.014+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:07.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:07.578+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:07.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:07.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:07.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:07.966+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:08.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:08.570+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:08.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:08.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:08.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:08.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:09.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:09.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:09.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:09.682+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:09.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:09.918+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:10.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:10.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:10.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:10.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:10.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:10.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:11.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:11.682+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:11.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:11.686+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:11.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:11.978+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:12.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:12.650+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:12.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:12.670+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:13.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:13.018+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:13.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:13.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:13.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:13.642+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:13.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:13.986+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:14.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:14.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:14.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:14.642+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:15.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:15.034+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:15.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:15.650+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:15.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:15.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:16.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:16.038+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:16.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:16.618+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:16.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:16.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:17.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:17.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:17.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:17.570+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:17.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:17.762+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:18.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:18.058+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:18.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:18.590+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:18.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:18.746+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:19.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:19.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:19.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:19.614+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:19.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:19.714+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:20.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:20.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:20.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:20.602+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:20.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:20.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:21.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:21.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:21.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:21.638+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:21.732 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:21.726+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:22.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:22.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:22.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:22.670+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:22.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:22.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:23.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:23.078+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:23.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:23.646+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:23.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:23.802+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:24.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:24.102+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:24.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:24.654+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:24.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:24.810+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:25.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:25.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:25.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:25.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:25.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:25.858+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:26.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:26.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:26.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:26.678+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:26.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:26.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:27.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:27.070+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:27.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:27.682+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:27.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:27.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:28.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:28.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:28.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:28.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:28.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:28.818+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:29.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:29.102+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:29.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:29.662+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:29.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:29.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:30.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:30.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:30.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:30.674+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:30.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:30.778+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:31.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:31.062+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:31.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:31.634+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:31.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:31.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:32.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:32.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:32.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:32.654+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:32.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:32.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:33.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:33.130+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:33.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:33.690+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:33.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:33.790+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:34.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:34.098+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:34.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:34.670+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:34.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:34.814+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:35.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:35.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:35.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:35.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:35.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:35.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:36.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:36.069+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:36.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:36.745+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:36.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:36.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:37.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:37.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:37.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:37.705+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:37.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:37.841+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:38.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:38.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:38.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:38.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:38.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:38.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:39.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:39.073+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:39.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:39.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:39.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:39.801+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:40.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:40.117+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:40.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:40.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:40.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:40.785+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:41.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:41.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:41.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:41.657+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:41.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:41.749+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:42.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:42.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:42.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:42.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:42.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:42.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:43.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:43.105+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:43.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:43.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:43.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:43.805+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:44.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:44.089+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:44.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:44.765+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:44.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:44.777+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:45.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:45.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:45.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:45.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:45.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:45.781+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:46.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:46.157+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:46.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:46.753+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:46.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:46.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:47.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:47.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:47.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:47.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:47.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:47.773+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:48.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:48.121+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:48.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:48.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:48.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:48.753+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:49.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:49.157+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:49.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:49.737+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:49.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:49.765+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:50.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:50.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:50.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:50.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:50.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:50.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:51.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:51.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:51.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:51.693+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:51.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:51.773+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:52.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:52.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:52.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:52.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:52.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:52.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:53.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:53.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:53.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:53.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:53.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:53.853+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:54.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:54.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:54.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:54.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:54.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:54.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:55.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:55.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:55.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:55.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:55.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:55.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:56.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:56.077+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:56.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:56.745+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:56.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:56.909+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:57.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:57.109+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:57.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:57.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:57.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:57.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:58.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:58.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:58.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:58.785+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:58.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:58.821+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:06:59.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:06:59.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:59.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:06:59.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:06:59.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:06:59.865+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:00.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:00.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:00.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:00.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:00.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:00.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:01.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:01.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:01.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:01.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:01.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:01.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:02.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:02.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:02.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:02.625+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:02.843 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:02.841+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:03.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:03.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:03.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:03.641+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:03.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:03.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:04.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:04.185+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:04.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:04.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:04.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:04.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:05.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:05.225+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:05.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:05.669+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:05.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:05.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:06.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:06.217+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:06.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:06.717+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:06.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:06.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:07.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:07.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:07.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:07.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:07.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:07.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:08.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:08.297+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:08.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:08.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:08.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:08.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:09.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:09.297+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:09.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:09.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:09.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:09.993+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:10.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:10.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:10.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:10.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:10.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:10.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:11.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:11.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:11.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:11.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:12.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:12.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:12.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:12.309+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:12.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:12.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:13.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:13.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:13.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:13.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:13.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:13.841+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:14.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:14.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:14.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:14.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:14.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:14.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:15.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:15.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:15.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:15.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:15.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:15.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:15.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:15.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:16.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:16.233+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:16.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:16.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:16.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:16.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:17.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:17.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:17.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:17.785+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:17.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:17.937+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:18.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:18.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:18.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:18.833+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:18.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:18.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:19.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:19.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:19.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:19.829+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:19.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:19.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:20.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:20.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:20.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:20.788+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:20.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:20.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:21.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:21.280+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:21.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:21.840+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:21.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:21.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:22.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:22.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:22.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:22.880+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:22.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:22.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:23.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:23.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:23.906 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:23.904+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:23.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:23.988+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:24.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:24.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:24.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:24.880+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:25.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:25.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:25.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:25.380+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:25.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:25.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:26.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:26.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:26.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:26.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:26.912 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:26.908+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:27.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:27.060+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:27.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:27.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:27.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:27.932+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:28.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:28.080+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:28.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:28.308+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:28.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:28.948+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:29.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:29.124+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:29.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:29.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:29.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:29.952+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:30.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:30.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:30.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:30.280+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:30.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:30.940+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:31.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:31.084+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:31.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:31.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:31.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:31.904+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:32.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:32.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:32.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:32.332+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:32.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:32.896+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:33.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:33.112+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:33.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:33.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:33.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:33.876+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:34.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:34.140+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:34.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:34.308+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:34.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:34.920+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:35.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:35.164+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:35.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:35.272+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:35.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:35.896+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:36.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:36.144+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:36.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:36.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:36.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:36.920+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:37.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:37.112+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:37.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:37.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:37.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:37.944+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:38.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:38.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:38.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:38.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:38.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:38.908+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:39.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:39.124+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:39.329 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:39.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:39.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:39.876+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:40.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:40.160+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:40.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:40.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:40.896 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:40.892+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:41.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:41.172+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:41.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:41.352+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:41.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:41.876+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:42.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:42.140+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:42.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:42.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:42.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:42.876+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:43.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:43.132+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:43.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:43.416+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:43.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:43.928+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:44.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:44.116+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:44.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:44.416+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:44.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:44.972+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:45.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:45.076+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:45.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:45.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:45.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:45.952+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:46.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:46.080+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:46.400 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:46.396+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:46.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:46.948+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:47.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:47.104+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:47.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:47.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:47.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:47.916+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:48.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:48.060+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:48.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:48.440+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:48.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:48.876+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:49.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:49.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:49.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:49.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:49.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:49.916+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:50.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:50.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:50.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:50.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:50.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:50.932+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:51.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:51.076+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:51.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:51.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:51.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:51.940+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:52.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:52.044+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:52.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:52.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:52.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:52.940+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:53.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:53.048+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:53.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:53.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:53.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:53.984+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:54.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:54.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:54.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:54.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:54.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:54.960+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:55.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:55.012+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:55.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:55.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:55.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:55.960+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:55.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:55.964+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:56.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:56.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:56.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:56.944+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:56.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:56.976+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:57.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:57.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:57.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:57.896+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:58.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:58.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:58.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:58.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:58.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:58.928+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:59.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:58.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:07:59.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:07:59.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:59.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:07:59.976+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:07:59.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:07:59.976+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:00.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:00.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:00.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:00.960+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:00.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:00.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:01.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:01.380+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:01.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:01.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:01.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:01.984+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:02.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:02.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:02.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:02.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:03.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:02.996+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:03.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:03.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:03.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:03.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:03.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:03.964+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:04.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:04.400+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:04.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:04.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:04.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:04.987+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:05.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:05.427+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:05.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:05.915+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:05.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:05.963+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:06.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:06.451+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:06.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:06.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:07.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:07.003+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:07.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:07.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:07.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:07.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:08.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:08.035+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:08.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:08.439+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:08.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:08.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:09.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:09.015+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:09.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:09.447+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:09.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:09.827+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:10.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:10.035+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:10.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:10.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:10.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:10.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:11.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:11.075+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:11.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:11.395+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:11.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:11.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:12.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:12.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:12.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:12.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:12.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:12.795+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:13.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:13.039+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:13.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:13.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:13.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:13.807+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:14.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:14.043+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:14.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:14.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:14.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:14.763+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:15.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:15.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:15.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:15.463+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:15.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:15.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:16.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:16.095+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:16.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:16.475+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:16.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:16.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:17.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:17.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:17.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:17.491+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:17.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:17.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:18.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:18.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:18.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:18.455+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:18.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:18.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:19.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:19.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:19.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:19.495+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:19.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:19.843+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:20.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:20.115+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:20.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:20.463+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:20.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:20.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:21.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:21.095+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:21.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:21.495+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:21.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:21.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:22.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:22.103+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:22.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:22.527+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:22.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:22.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:23.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:23.151+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:23.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:23.567+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:23.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:23.775+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:24.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:24.127+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:24.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:24.531+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:24.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:24.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:25.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:25.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:25.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:25.563+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:25.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:25.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:26.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:26.147+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:26.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:26.551+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:26.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:26.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:27.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:27.199+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:27.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:27.535+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:27.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:27.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:28.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:28.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:28.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:28.571+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:28.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:28.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:29.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:29.175+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:29.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:29.611+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:29.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:29.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:30.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:30.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:30.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:30.639+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:30.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:30.923+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:31.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:31.183+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:31.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:31.683+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:31.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:31.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:32.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:32.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:32.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:32.675+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:32.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:32.959+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:33.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:33.187+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:33.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:33.691+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:33.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:33.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:34.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:34.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:34.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:34.651+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:34.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:34.931+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:35.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:35.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:35.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:35.699+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:35.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:35.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:36.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:36.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:36.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:36.747+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:36.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:36.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:37.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:37.095+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:37.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:37.727+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:37.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:37.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:38.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:38.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:38.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:38.759+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:38.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:38.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:39.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:39.103+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:39.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:39.779+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:39.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:39.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:40.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:40.095+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:40.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:40.819+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:40.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:40.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:41.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:41.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:41.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:41.775+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:41.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:41.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:42.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:42.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:42.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:42.791+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:42.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:42.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:43.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:43.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:43.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:43.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:43.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:43.839+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:44.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:44.095+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:44.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:44.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:44.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:44.867+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:45.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:45.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:45.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:45.803+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:45.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:45.819+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:46.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:46.107+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:46.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:46.755+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:46.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:46.771+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:47.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:47.147+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:47.787 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:47.783+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:47.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:47.783+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:48.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:48.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:48.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:48.763+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:48.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:48.775+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:49.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:49.179+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:49.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:49.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:49.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:49.818+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:50.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:50.182+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:50.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:50.766+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:50.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:50.814+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:51.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:51.190+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:51.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:51.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:51.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:51.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:52.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:52.226+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:52.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:52.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:52.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:52.894+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:53.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:53.226+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:53.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:53.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:53.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:53.930+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:54.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:54.206+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:54.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:54.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:54.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:54.886+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:55.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:55.254+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:55.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:55.726+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:55.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:55.882+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:56.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:56.238+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:56.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:56.686+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:56.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:56.898+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:57.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:57.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:57.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:57.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:57.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:57.886+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:58.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:58.306+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:58.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:58.698+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:58.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:58.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:08:59.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:08:59.290+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:59.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:08:59.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:08:59.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:08:59.954+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:00.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:00.246+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:00.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:00.770+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:00.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:00.934+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:01.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:01.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:01.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:01.738+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:01.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:01.950+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:02.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:02.226+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:02.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:02.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:02.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:02.978+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:03.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:03.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:03.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:03.758+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:03.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:03.986+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:04.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:04.298+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:04.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:04.742+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:05.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:05.014+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:05.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:05.322+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:05.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:05.786+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:06.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:06.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:06.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:06.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:06.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:06.758+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:07.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:07.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:07.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:07.314+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:07.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:07.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:08.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:08.046+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:08.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:08.266+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:08.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:08.798+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:09.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:09.026+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:09.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:09.302+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:09.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:09.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:10.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:10.026+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:10.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:10.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:10.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:10.798+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:11.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:10.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:11.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:11.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:11.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:11.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:11.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:11.950+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:12.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:12.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:12.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:12.742+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:12.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:12.934+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:13.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:13.422+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:13.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:13.774+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:13.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:13.890+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:14.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:14.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:14.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:14.782+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:14.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:14.882+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:15.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:15.422+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:15.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:15.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:15.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:15.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:16.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:16.410+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:16.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:16.774+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:16.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:16.794+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:17.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:17.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:17.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:17.794+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:17.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:17.830+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:18.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:18.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:18.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:18.818+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:18.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:18.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:19.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:19.402+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:19.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:19.814+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:19.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:19.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:20.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:20.386+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:20.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:20.830+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:20.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:20.874+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:21.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:21.374+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:21.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:21.870+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:21.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:21.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:22.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:22.330+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:22.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:22.822+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:22.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:22.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:23.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:23.354+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:23.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:23.790+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:23.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:23.886+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:24.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:24.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:24.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:24.750+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:24.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:24.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:25.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:25.402+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:25.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:25.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:25.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:25.846+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:26.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:26.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:26.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:26.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:26.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:26.878+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:27.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:27.338+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:27.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:27.790+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:27.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:27.834+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:28.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:28.366+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:28.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:28.762+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:28.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:28.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:29.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:29.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:29.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:29.718+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:29.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:29.838+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:30.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:30.338+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:30.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:30.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:30.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:30.878+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:31.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:31.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:31.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:31.726+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:31.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:31.894+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:32.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:32.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:32.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:32.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:32.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:32.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:33.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:33.354+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:33.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:33.706+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:33.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:33.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:34.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:34.386+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:34.701 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:34.694+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:34.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:34.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:35.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:35.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:35.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:35.658+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:35.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:35.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:36.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:36.374+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:36.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:36.645+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:36.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:36.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:37.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:37.381+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:37.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:37.677+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:37.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:37.937+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:38.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:38.345+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:38.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:38.681+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:38.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:38.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:39.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:39.389+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:39.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:39.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:40.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:39.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:40.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:40.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:40.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:40.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:41.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:41.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:41.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:41.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:41.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:41.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:42.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:42.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:42.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:42.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:42.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:42.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:43.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:43.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:43.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:43.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:43.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:43.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:44.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:44.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:44.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:44.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:44.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:44.657+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:45.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:45.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:45.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:45.505+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:45.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:45.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:46.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:46.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:46.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:46.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:46.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:46.657+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:47.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:47.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:47.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:47.497+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:47.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:47.693+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:48.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:48.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:48.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:48.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:48.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:48.729+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:49.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:49.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:49.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:49.513+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:49.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:49.729+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:50.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:50.121+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:50.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:50.557+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:50.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:50.737+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:51.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:51.157+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:51.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:51.589+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:51.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:51.709+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:52.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:52.113+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:52.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:52.565+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:52.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:52.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:53.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:53.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:53.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:53.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:53.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:53.717+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:54.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:54.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:54.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:54.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:54.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:54.673+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:55.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:55.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:55.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:55.501+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:55.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:55.629+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:56.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:56.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:56.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:56.505+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:56.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:56.621+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:57.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:57.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:57.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:57.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:57.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:57.629+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:58.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:58.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:58.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:58.485+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:58.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:58.617+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:59.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:09:59.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:09:59.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:09:59.533+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:09:59.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:09:59.653+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:00.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:00.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:00.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:00.521+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:00.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:00.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:01.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:01.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:01.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:01.533+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:01.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:01.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:02.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:02.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:02.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:02.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:02.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:02.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:03.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:03.089+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:03.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:03.493+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:03.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:03.741+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:04.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:04.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:04.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:04.453+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:04.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:04.765+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:05.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:05.109+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:05.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:05.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:05.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:05.717+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:06.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:06.153+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:06.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:06.405+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:06.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:06.701+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:07.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:07.141+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:07.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:07.405+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:07.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:07.721+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:08.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:08.133+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:08.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:08.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:08.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:08.765+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:09.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:09.153+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:09.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:09.437+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:09.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:09.745+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:10.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:10.185+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:10.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:10.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:10.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:10.789+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:11.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:11.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:11.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:11.441+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:11.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:11.817+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:12.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:12.233+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:12.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:12.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:12.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:12.837+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:13.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:13.253+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:13.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:13.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:13.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:13.865+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:14.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:14.281+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:14.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:14.417+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:14.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:14.861+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:15.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:15.273+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:15.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:15.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:15.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:15.901+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:16.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:16.269+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:16.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:16.405+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:16.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:16.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:17.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:17.257+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:17.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:17.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:17.943 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:17.941+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:18.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:18.297+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:18.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:18.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:18.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:18.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:19.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:19.325+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:19.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:19.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:19.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:19.989+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:20.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:20.349+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:20.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:20.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:20.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:20.953+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:21.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:21.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:21.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:21.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:21.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:21.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:22.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:22.321+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:22.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:22.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:22.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:22.929+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:23.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:23.293+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:23.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:23.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:23.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:23.941+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:24.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:24.293+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:24.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:24.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:24.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:24.905+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:25.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:25.324+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:25.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:25.416+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:25.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:25.892+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:26.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:26.284+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:26.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:26.420+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:26.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:26.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:27.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:27.292+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:27.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:27.460+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:27.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:27.948+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:28.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:28.324+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:28.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:28.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:29.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:29.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:29.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:29.348+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:29.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:29.496+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:30.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:30.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:30.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:30.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:30.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:30.536+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:31.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:31.028+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:31.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:31.364+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:31.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:31.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:32.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:32.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:32.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:32.316+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:32.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:32.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:33.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:33.056+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:33.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:33.320+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:33.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:33.540+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:34.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:34.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:34.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:34.316+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:34.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:34.572+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:35.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:35.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:35.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:35.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:35.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:35.564+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:36.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:36.156+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:36.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:36.308+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:36.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:36.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:37.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:37.196+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:37.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:37.356+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:37.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:37.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:38.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:38.172+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:38.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:38.356+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:38.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:38.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:39.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:39.140+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:39.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:39.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:39.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:39.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:40.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:40.152+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:40.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:40.324+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:40.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:40.616+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:41.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:41.136+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:41.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:41.288+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:41.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:41.660+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:42.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:42.180+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:42.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:42.324+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:42.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:42.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:43.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:43.220+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:43.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:43.296+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:43.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:43.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:44.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:44.244+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:44.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:44.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:44.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:44.620+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:45.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:45.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:45.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:45.312+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:45.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:45.628+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:46.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:46.220+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:46.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:46.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:46.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:46.680+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:47.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:47.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:47.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:47.352+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:47.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:47.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:48.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:48.232+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:48.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:48.388+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:48.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:48.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:49.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:49.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:49.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:49.436+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:49.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:49.676+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:50.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:50.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:50.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:50.472+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:50.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:50.724+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:51.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:51.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:51.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:51.480+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:51.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:51.736+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:52.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:52.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:52.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:52.524+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:52.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:52.700+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:53.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:53.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:53.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:53.572+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:53.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:53.688+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:54.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:54.316+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:54.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:54.572+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:54.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:54.684+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:55.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:55.364+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:55.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:55.596+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:55.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:55.672+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:56.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:56.360+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:56.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:56.600+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:56.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:56.716+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:57.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:57.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:57.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:57.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:57.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:57.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:58.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:58.364+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:58.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:58.632+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:58.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:58.768+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:59.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:10:59.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:10:59.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:10:59.592+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:10:59.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:10:59.768+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:00.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:00.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:00.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:00.572+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:00.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:00.816+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:01.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:01.364+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:01.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:01.524+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:01.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:01.832+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:02.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:02.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:02.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:02.508+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:02.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:02.816+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:03.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:03.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:03.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:03.488+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:03.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:03.832+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:04.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:04.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:04.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:04.452+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:04.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:04.868+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:05.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:05.476+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:05.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:05.500+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:05.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:05.828+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:06.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:06.460+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:06.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:06.544+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:06.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:06.852+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:07.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:07.452+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:07.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:07.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:07.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:07.888+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:08.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:08.460+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:08.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:08.524+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:08.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:08.900+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:09.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:09.492+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:09.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:09.532+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:09.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:09.940+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:10.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:10.512+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:10.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:10.532+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:10.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:10.944+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:11.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:11.476+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:11.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:11.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:11.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:11.932+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:12.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:12.480+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:12.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:12.528+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:12.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:12.908+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:13.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:13.451+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:13.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:13.523+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:13.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:13.923+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:14.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:14.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:14.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:14.567+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:14.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:14.963+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:15.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:15.371+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:15.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:15.543+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:15.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:15.947+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:16.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:16.363+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:16.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:16.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:16.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:16.943+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:17.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:17.339+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:17.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:17.559+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:17.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:17.895+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:18.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:18.307+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:18.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:18.587+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:18.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:18.867+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:19.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:19.347+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:19.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:19.579+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:19.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:19.891+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:20.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:20.395+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:20.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:20.543+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:20.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:20.851+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:21.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:21.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:21.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:21.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:21.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:21.875+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:22.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:22.351+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:22.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:22.583+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:22.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:22.895+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:23.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:23.395+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:23.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:23.619+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:23.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:23.915+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:24.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:24.391+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:24.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:24.583+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:24.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:24.923+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:25.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:25.363+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:25.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:25.623+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:25.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:25.879+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:26.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:26.351+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:26.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:26.639+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:26.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:26.891+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:27.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:27.355+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:27.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:27.627+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:27.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:27.919+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:28.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:28.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:28.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:28.639+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:28.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:28.875+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:29.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:29.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:29.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:29.675+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:29.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:29.923+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:30.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:30.463+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:30.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:30.699+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:30.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:30.931+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:31.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:31.487+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:31.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:31.739+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:31.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:31.951+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:32.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:32.443+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:32.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:32.779+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:32.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:32.907+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:33.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:33.491+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:33.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:33.735+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:33.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:33.931+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:34.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:34.471+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:34.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:34.759+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:34.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:34.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:35.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:35.519+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:35.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:35.727+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:35.938 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:35.931+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:36.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:36.523+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:36.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:36.775+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:36.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:36.903+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:37.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:37.527+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:37.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:37.787+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:37.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:37.895+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:38.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:38.479+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:38.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:38.795+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:38.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:38.947+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:39.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:39.491+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:39.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:39.827+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:39.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:39.951+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:40.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:40.447+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:40.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:40.855+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:40.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:40.907+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:41.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:41.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:41.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:41.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:41.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:41.931+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:42.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:42.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:42.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:42.887+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:42.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:42.963+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:43.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:43.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:43.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:43.899+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:43.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:43.995+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:44.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:44.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:44.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:44.871+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:45.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:45.011+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:45.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:45.395+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:45.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:45.875+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:46.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:46.027+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:46.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:46.411+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:46.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:46.867+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:47.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:46.999+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:47.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:47.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:47.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:47.911+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:48.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:48.023+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:48.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:48.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:48.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:48.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:49.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:49.047+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:49.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:49.439+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:49.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:49.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:50.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:50.099+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:50.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:50.407+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:50.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:50.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:51.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:51.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:51.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:51.411+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:51.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:51.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:52.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:52.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:52.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:52.407+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:52.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:52.903+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:53.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:53.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:53.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:53.447+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:53.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:53.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:54.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:54.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:54.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:54.455+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:54.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:54.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:55.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:55.103+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:55.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:55.451+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:55.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:55.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:56.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:56.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:56.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:56.415+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:56.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:56.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:57.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:57.047+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:57.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:57.387+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:57.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:57.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:58.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:58.023+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:58.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:58.347+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:58.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:58.935+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:59.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:11:59.031+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:11:59.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:11:59.387+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:11:59.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:11:59.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:00.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:00.043+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:00.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:00.355+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:00.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:00.931+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:01.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:00.999+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:01.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:01.375+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:01.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:01.962+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:01.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:01.994+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:02.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:02.338+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:02.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:02.986+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:03.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:02.994+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:03.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:03.366+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:03.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:03.950+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:03.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:03.950+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:04.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:04.386+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:04.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:04.906+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:04.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:04.926+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:05.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:05.406+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:05.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:05.882+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:05.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:05.958+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:06.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:06.374+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:06.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:06.914+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:06.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:06.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:07.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:07.350+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:07.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:07.898+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:07.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:07.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:08.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:08.306+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:08.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:08.906+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:08.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:08.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:09.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:09.314+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:09.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:09.882+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:09.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:09.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:10.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:10.278+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:10.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:10.914+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:10.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:10.930+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:11.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:11.298+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:11.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:11.894+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:11.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:11.914+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:12.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:12.326+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:12.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:12.906+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:12.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:12.934+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:13.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:13.366+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:13.903 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:13.898+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:13.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:13.942+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:14.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:14.330+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:14.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:14.878+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:14.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:14.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:15.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:15.306+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:15.909 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:15.902+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:15.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:15.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:16.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:16.314+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:16.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:16.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:16.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:16.870+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:17.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:17.290+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:17.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:17.822+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:17.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:17.834+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:18.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:18.258+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:18.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:18.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:18.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:18.858+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:19.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:19.206+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:19.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:19.738+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:19.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:19.834+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:20.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:20.246+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:20.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:20.782+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:20.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:20.878+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:21.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:21.274+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:21.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:21.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:21.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:21.914+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:22.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:22.298+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:22.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:22.862+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:22.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:22.946+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:23.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:23.310+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:23.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:23.906+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:23.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:23.950+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:24.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:24.342+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:24.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:24.950+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:24.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:24.958+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:25.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:25.354+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:25.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:25.938+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:26.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:25.998+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:26.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:26.330+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:26.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:26.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:27.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:26.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:27.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:27.346+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:27.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:27.942+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:28.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:28.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:28.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:28.298+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:28.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:28.986+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:29.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:29.070+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:29.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:29.310+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:29.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:29.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:30.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:30.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:30.291 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:30.286+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:30.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:30.982+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:31.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:31.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:31.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:31.246+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:31.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:31.990+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:32.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:32.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:32.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:32.258+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:32.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:32.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:33.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:33.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:33.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:33.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:33.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:33.974+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:34.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:34.150+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:34.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:34.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:34.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:34.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:35.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:35.110+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:35.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:35.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:35.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:35.934+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:36.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:36.098+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:36.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:36.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:36.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:36.958+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:37.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:37.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:37.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:37.162+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:37.959 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:37.954+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:38.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:38.066+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:38.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:38.186+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:38.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:38.962+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:39.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:39.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:39.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:39.182+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:39.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:39.970+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:40.112 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:40.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:40.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:40.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:41.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:40.994+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:41.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:41.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:41.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:41.158+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:41.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:41.986+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:42.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:42.138+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:42.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:42.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:42.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:42.990+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:43.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:43.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:43.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:43.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:43.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:43.970+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:44.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:44.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:44.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:44.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:44.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:44.954+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:45.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:45.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:45.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:45.118+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:45.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:45.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:46.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:46.114+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:46.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:46.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:46.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:46.882+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:47.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:47.098+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:47.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:47.110+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:47.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:47.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:48.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:48.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:48.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:48.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:48.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:48.850+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:49.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:49.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:49.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:49.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:49.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:49.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:50.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:50.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:50.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:50.125+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:50.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:50.901+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:51.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:51.077+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:51.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:51.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:51.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:51.885+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:52.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:52.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:52.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:52.101+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:52.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:52.917+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:53.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:53.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:53.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:53.129+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:53.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:53.953+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:54.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:54.105+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:54.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:54.109+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:54.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:54.917+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:55.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:55.109+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:55.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:55.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:55.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:55.961+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:56.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:56.089+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:56.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:56.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:56.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:56.937+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:57.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:57.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:57.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:57.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:57.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:57.901+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:58.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:58.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:58.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:58.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:58.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:58.873+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:59.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:12:59.101+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:12:59.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:12:59.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:12:59.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:12:59.861+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:00.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:00.133+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:00.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:00.173+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:00.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:00.893+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:01.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:01.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:01.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:01.169+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:01.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:01.905+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:02.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:02.097+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:02.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:02.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:02.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:02.861+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:03.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:03.137+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:03.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:03.145+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:03.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:03.817+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:04.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:04.105+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:04.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:04.165+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:04.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:04.801+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:05.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:05.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:05.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:05.161+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:05.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:05.769+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:06.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:06.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:06.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:06.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:06.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:06.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:07.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:07.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:07.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:07.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:07.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:07.773+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:08.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:08.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:08.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:08.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:08.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:08.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:09.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:09.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:09.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:09.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:09.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:09.701+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:10.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:10.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:10.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:10.229+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:10.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:10.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:11.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:11.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:11.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:11.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:11.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:11.645+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:12.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:12.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:12.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:12.237+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:12.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:12.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:13.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:13.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:13.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:13.217+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:13.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:13.645+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:14.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:14.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:14.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:14.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:14.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:14.609+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:15.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:15.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:15.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:15.237+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:15.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:15.601+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:16.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:16.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:16.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:16.241+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:16.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:16.569+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:17.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:17.077+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:17.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:17.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:17.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:17.621+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:18.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:18.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:18.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:18.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:18.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:18.649+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:19.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:19.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:19.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:19.281+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:19.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:19.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:20.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:20.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:20.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:20.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:20.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:20.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:20.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:20.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:21.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:21.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:21.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:21.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:22.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:21.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:22.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:22.241+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:22.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:22.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:23.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:23.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:23.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:23.233+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:23.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:23.685+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:24.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:24.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:24.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:24.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:24.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:24.689+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:25.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:24.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:25.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:25.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:25.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:25.685+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:25.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:25.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:26.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:26.245+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:26.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:26.725+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:26.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:26.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:27.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:27.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:27.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:27.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:27.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:27.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:28.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:28.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:28.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:28.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:29.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:29.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:29.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:29.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:29.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:29.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:30.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:30.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:30.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:30.189+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:30.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:30.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:31.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:31.029+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:31.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:31.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:31.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:31.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:32.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:32.045+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:32.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:32.149+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:32.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:32.829+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:33.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:33.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:33.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:33.185+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:33.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:33.829+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:34.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:34.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:34.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:34.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:34.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:34.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:35.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:35.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:35.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:35.097+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:35.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:35.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:36.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:36.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:36.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:36.121+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:36.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:36.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:37.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:37.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:37.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:37.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:37.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:37.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:38.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:38.068+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:38.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:38.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:38.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:38.764+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:39.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:39.052+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:39.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:39.112+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:39.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:39.792+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:40.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:40.068+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:40.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:40.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:40.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:40.756+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:41.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:41.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:41.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:41.104+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:41.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:41.716+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:42.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:42.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:42.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:42.108+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:42.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:42.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:43.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:43.104+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:43.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:43.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:43.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:43.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:44.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:44.084+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:44.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:44.136+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:44.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:44.664+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:45.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:45.076+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:45.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:45.124+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:45.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:45.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:46.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:46.052+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:46.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:46.152+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:46.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:46.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:47.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:47.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:47.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:47.156+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:47.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:47.728+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:48.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:48.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:48.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:48.136+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:48.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:48.768+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:49.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:49.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:49.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:49.152+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:49.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:49.724+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:50.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:50.020+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:50.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:50.200+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:50.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:50.764+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:51.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:51.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:51.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:51.244+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:51.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:51.716+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:52.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:52.068+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:52.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:52.280+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:52.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:52.752+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:53.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:53.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:53.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:53.252+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:53.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:53.772+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:54.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:54.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:54.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:54.280+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:54.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:54.756+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:55.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:55.036+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:55.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:55.236+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:55.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:55.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:56.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:56.064+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:56.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:56.264+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:56.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:56.700+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:57.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:57.084+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:57.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:57.300+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:57.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:57.720+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:58.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:58.044+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:58.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:58.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:58.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:58.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:59.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:13:59.000+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:13:59.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:13:59.308+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:13:59.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:13:59.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:00.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:00.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:00.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:00.332+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:00.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:00.732+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:01.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:01.060+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:01.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:01.320+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:01.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:01.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:02.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:02.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:02.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:02.280+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:02.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:02.696+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:03.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:03.048+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:03.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:03.296+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:03.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:03.680+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:04.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:04.016+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:04.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:04.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:04.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:04.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:04.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:04.968+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:05.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:05.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:05.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:05.688+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:05.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:05.984+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:06.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:06.360+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:06.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:06.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:06.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:06.992+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:07.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:07.372+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:07.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:07.668+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:07.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:07.996+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:08.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:08.396+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:08.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:08.648+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:08.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:08.976+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:09.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:09.384+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:09.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:09.664+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:09.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:09.980+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:10.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:10.408+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:10.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:10.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:10.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:10.984+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:11.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:11.384+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:11.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:11.692+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:11.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:11.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:12.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:12.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:12.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:12.684+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:12.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:12.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:13.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:13.320+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:13.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:13.652+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:13.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:13.948+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:14.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:14.300+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:14.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:14.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:14.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:14.952+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:15.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:15.316+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:15.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:15.584+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:15.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:15.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:16.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:16.352+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:16.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:16.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:16.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:16.916+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:17.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:17.372+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:17.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:17.580+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:17.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:17.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:18.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:18.412+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:18.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:18.624+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:18.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:18.924+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:19.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:19.436+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:19.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:19.656+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:19.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:19.888+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:20.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:20.456+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:20.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:20.704+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:20.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:20.876+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:21.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:21.412+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:21.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:21.744+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:21.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:21.888+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:22.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:22.416+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:22.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:22.760+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:22.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:22.876+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:23.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:23.368+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:23.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:23.760+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:23.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:23.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:24.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:24.380+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:24.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:24.780+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:24.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:24.816+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:25.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:25.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:25.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:25.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:25.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:25.843+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:26.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:26.371+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:26.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:26.719+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:26.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:26.839+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:27.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:27.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:27.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:27.735+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:27.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:27.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:28.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:28.359+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:28.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:28.691+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:28.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:28.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:29.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:29.379+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:29.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:29.715+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:29.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:29.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:30.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:30.411+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:30.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:30.711+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:30.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:30.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:31.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:31.415+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:31.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:31.707+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:31.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:31.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:32.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:32.383+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:32.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:32.719+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:33.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:32.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:33.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:33.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:33.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:33.727+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:33.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:33.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:34.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:34.435+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:34.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:34.695+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:34.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:34.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:35.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:35.423+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:35.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:35.715+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:35.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:35.983+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:36.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:36.463+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:36.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:36.759+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:37.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:37.003+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:37.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:37.483+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:37.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:37.787+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:38.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:38.055+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:38.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:38.475+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:38.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:38.795+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:39.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:39.051+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:39.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:39.499+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:39.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:39.819+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:40.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:40.003+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:40.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:40.519+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:40.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:40.775+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:40.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:40.983+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:41.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:41.491+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:41.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:41.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:41.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:41.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:42.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:42.503+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:42.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:42.755+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:43.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:42.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:43.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:43.459+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:43.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:43.787+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:43.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:43.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:44.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:44.483+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:44.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:44.783+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:44.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:44.975+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:45.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:45.527+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:45.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:45.787+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:45.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:45.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:46.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:46.575+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:46.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:46.795+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:46.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:46.907+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:47.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:47.615+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:47.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:47.759+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:47.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:47.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:48.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:48.599+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:48.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:48.743+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:48.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:48.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:49.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:49.551+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:49.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:49.751+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:49.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:49.927+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:50.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:50.519+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:50.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:50.779+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:50.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:50.915+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:51.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:51.483+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:51.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:51.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:51.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:51.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:52.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:52.531+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:52.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:52.791+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:52.943 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:52.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:53.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:53.535+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:53.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:53.831+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:53.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:53.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:54.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:54.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:54.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:54.827+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:54.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:54.919+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:55.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:55.539+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:55.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:55.871+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:55.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:55.911+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:56.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:56.543+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:56.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:56.891+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:56.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:56.931+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:57.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:57.499+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:57.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:57.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:57.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:57.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:58.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:58.483+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:58.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:58.919+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:58.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:58.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:59.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:14:59.519+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:14:59.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:14:59.927+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:14:59.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:14:59.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:00.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:00.527+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:00.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:00.935+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:00.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:00.963+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:01.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:01.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:01.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:01.919+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:01.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:01.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:02.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:02.563+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:02.912 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:02.907+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:02.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:02.979+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:03.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:03.563+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:03.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:03.943+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:04.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:04.011+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:04.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:04.527+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:04.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:04.943+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:05.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:05.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:05.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:05.495+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:05.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:05.959+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:05.973 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:05.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:06.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:06.531+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:06.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:06.963+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:06.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:06.975+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:07.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:07.543+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:07.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:07.915+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:07.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:07.991+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:08.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:08.523+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:08.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:08.883+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:09.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:09.007+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:09.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:09.571+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:09.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:09.923+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:09.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:09.991+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:10.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:10.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:10.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:10.943+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:10.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:10.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:11.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:11.559+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:11.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:11.907+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:11.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:11.939+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:12.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:12.559+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:12.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:12.890+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:12.974 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:12.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:13.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:13.510+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:13.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:13.858+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:13.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:13.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:14.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:14.466+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:14.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:14.850+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:14.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:14.950+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:15.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:15.474+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:15.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:15.890+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:15.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:15.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:16.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:16.478+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:16.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:16.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:16.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:16.934+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:17.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:17.434+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:17.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:17.834+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:17.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:17.970+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:18.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:18.470+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:18.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:18.882+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:18.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:18.954+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:19.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:19.518+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:19.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:19.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:20.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:20.006+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:20.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:20.538+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:20.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:20.874+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:21.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:21.006+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:21.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:21.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:21.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:21.830+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:21.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:21.994+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:22.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:22.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:22.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:22.810+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:23.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:23.014+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:23.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:23.654+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:23.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:23.770+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:24.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:24.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:24.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:24.682+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:24.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:24.766+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:25.035 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:25.030+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:25.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:25.710+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:25.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:25.726+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:26.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:26.050+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:26.724 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:26.718+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:26.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:26.722+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:27.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:27.054+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:27.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:27.698+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:27.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:27.726+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:28.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:28.050+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:28.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:28.738+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:28.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:28.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:29.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:29.102+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:29.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:29.710+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:29.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:29.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:30.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:30.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:30.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:30.742+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:30.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:30.742+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:31.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:31.106+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:31.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:31.742+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:31.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:31.778+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:32.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:32.090+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:32.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:32.766+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:32.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:32.770+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:33.093 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:33.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:33.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:33.750+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:33.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:33.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:34.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:34.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:34.724 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:34.718+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:34.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:34.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:35.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:35.050+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:35.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:35.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:35.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:35.814+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:36.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:36.074+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:36.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:36.770+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:36.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:36.834+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:37.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:37.050+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:37.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:37.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:37.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:37.874+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:38.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:38.038+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:38.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:38.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:38.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:38.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:39.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:39.002+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:39.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:39.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:39.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:39.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:40.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:40.046+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:40.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:40.774+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:40.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:40.962+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:41.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:41.054+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:41.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:41.770+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:41.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:41.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:42.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:42.094+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:42.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:42.774+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:42.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:42.962+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:43.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:43.118+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:43.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:43.730+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:44.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:43.998+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:44.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:44.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:44.769 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:44.762+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:45.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:45.014+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:45.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:45.218+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:45.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:45.778+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:46.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:46.006+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:46.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:46.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:46.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:46.730+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:46.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:46.966+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:47.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:47.306+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:47.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:47.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:47.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:47.926+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:48.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:48.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:48.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:48.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:48.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:48.962+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:49.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:49.246+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:49.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:49.666+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:50.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:50.006+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:50.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:50.242+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:50.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:50.694+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:51.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:51.054+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:51.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:51.234+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:51.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:51.682+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:52.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:52.090+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:52.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:52.278+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:52.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:52.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:53.063 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:53.058+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:53.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:53.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:53.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:53.658+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:54.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:54.038+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:54.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:54.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:54.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:54.626+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:55.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:55.082+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:55.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:55.282+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:55.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:55.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:56.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:56.038+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:56.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:56.298+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:56.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:56.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:57.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:57.086+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:57.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:57.322+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:57.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:57.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:58.051 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:58.046+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:58.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:58.302+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:58.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:58.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:15:59.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:15:59.078+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:59.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:15:59.338+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:15:59.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:15:59.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:00.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:00.085+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:00.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:00.361+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:00.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:00.625+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:01.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:01.113+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:01.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:01.401+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:01.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:01.677+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:02.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:02.109+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:02.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:02.389+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:02.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:02.701+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:03.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:03.117+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:03.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:03.385+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:03.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:03.685+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:04.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:04.081+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:04.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:04.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:04.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:04.657+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:05.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:05.037+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:05.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:05.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:05.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:05.613+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:06.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:06.033+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:06.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:06.481+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:06.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:06.625+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:07.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:07.041+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:07.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:07.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:07.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:07.581+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:08.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:08.057+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:08.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:08.409+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:08.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:08.613+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:09.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:09.065+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:09.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:09.389+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:09.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:09.653+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:10.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:10.113+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:10.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:10.385+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:10.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:10.697+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:11.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:11.145+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:11.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:11.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:11.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:11.705+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:12.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:12.121+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:12.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:12.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:12.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:12.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:13.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:13.165+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:13.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:13.505+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:13.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:13.749+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:14.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:14.181+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:14.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:14.489+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:14.797 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:14.793+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:15.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:15.217+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:15.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:15.469+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:15.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:15.757+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:16.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:16.229+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:16.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:16.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:16.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:16.733+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:17.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:17.213+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:17.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:17.469+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:17.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:17.693+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:18.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:18.185+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:18.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:18.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:18.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:18.741+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:19.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:19.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:19.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:19.469+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:19.701 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:19.697+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:20.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:20.133+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:20.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:20.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:20.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:20.689+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:21.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:21.109+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:21.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:21.401+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:21.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:21.721+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:22.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:22.133+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:22.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:22.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:22.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:22.753+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:23.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:23.141+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:23.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:23.369+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:23.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:23.801+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:24.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:24.177+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:24.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:24.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:24.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:24.777+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:25.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:25.213+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:25.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:25.353+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:25.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:25.825+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:26.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:26.237+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:26.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:26.389+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:26.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:26.805+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:27.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:27.245+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:27.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:27.369+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:27.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:27.853+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:28.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:28.273+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:28.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:28.389+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:28.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:28.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:29.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:29.261+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:29.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:29.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:29.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:29.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:30.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:30.289+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:30.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:30.449+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:30.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:30.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:31.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:31.309+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:31.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:31.445+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:31.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:31.829+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:32.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:32.337+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:32.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:32.445+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:32.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:32.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:33.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:33.301+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:33.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:33.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:33.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:33.857+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:34.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:34.273+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:34.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:34.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:34.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:34.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:35.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:35.253+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:35.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:35.397+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:35.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:35.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:36.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:36.289+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:36.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:36.441+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:36.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:36.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:37.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:37.289+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:37.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:37.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:37.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:37.949+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:38.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:38.313+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:38.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:38.385+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:38.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:38.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:39.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:39.281+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:39.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:39.349+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:39.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:39.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:40.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:40.265+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:40.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:40.333+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:40.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:40.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:41.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:41.217+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:41.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:41.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:41.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:41.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:42.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:42.201+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:42.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:42.373+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:42.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:42.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:43.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:43.205+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:43.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:43.385+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:43.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:43.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:44.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:44.221+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:44.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:44.365+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:45.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:45.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:45.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:45.189+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:45.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:45.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:46.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:46.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:46.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:46.233+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:46.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:46.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:47.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:47.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:47.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:47.204+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:47.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:47.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:48.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:48.044+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:48.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:48.228+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:48.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:48.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:49.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:49.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:49.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:49.180+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:49.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:49.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:50.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:50.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:50.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:50.140+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:50.281 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:50.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:51.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:51.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:51.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:51.136+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:51.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:51.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:52.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:52.100+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:52.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:52.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:52.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:52.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:53.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:53.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:53.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:53.152+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:53.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:53.248+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:54.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:54.064+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:54.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:54.180+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:54.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:54.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:55.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:55.048+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:55.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:55.152+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:55.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:55.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:56.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:56.012+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:56.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:56.120+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:56.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:56.244+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:57.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:57.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:57.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:57.112+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:57.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:57.284+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:58.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:58.072+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:58.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:58.088+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:58.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:58.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:59.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:16:59.096+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:16:59.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:16:59.096+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:16:59.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:16:59.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:00.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:00.084+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:00.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:00.116+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:00.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:00.304+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:01.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:01.064+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:01.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:01.076+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:01.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:01.352+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:02.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:02.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:02.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:02.108+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:02.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:02.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:03.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:03.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:03.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:03.148+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:03.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:03.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:04.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:04.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:04.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:04.120+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:04.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:04.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:05.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:05.036+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:05.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:05.132+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:05.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:05.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:06.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:06.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:06.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:06.112+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:06.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:06.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:07.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:07.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:07.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:07.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:07.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:07.420+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:07.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:07.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:08.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:08.196+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:08.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:08.392+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:08.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:08.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:09.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:09.220+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:09.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:09.376+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:09.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:09.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:10.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:10.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:10.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:10.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:10.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:10.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:11.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:11.204+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:11.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:11.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:11.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:11.852+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:12.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:12.256+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:12.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:12.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:12.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:12.860+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:13.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:13.276+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:13.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:13.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:13.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:13.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:14.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:14.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:14.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:14.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:14.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:14.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:15.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:15.352+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:15.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:15.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:15.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:15.920+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:16.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:16.388+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:16.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:16.400+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:16.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:16.920+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:17.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:17.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:17.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:17.428+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:17.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:17.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:18.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:18.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:18.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:18.416+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:18.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:18.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:19.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:19.368+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:19.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:19.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:19.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:19.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:20.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:20.376+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:20.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:20.400+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:20.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:20.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:21.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:21.404+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:21.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:21.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:21.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:21.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:22.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:22.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:22.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:22.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:22.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:22.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:23.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:23.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:23.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:23.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:23.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:23.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:24.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:24.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:24.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:24.464+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:24.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:24.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:25.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:25.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:25.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:25.436+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:25.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:25.900+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:26.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:26.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:26.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:26.448+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:26.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:26.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:27.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:27.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:27.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:27.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:27.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:27.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:28.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:28.460+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:28.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:28.472+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:28.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:28.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:29.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:29.468+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:29.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:29.488+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:29.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:29.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:30.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:30.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:30.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:30.480+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:31.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:31.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:31.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:31.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:31.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:31.484+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:32.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:32.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:32.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:32.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:32.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:32.476+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:33.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:33.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:33.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:33.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:33.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:33.436+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:34.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:34.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:34.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:34.367+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:34.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:34.455+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:35.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:35.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:35.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:35.339+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:35.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:35.455+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:36.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:36.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:36.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:36.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:36.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:36.487+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:37.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:36.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:37.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:37.319+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:37.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:37.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:37.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:37.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:38.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:38.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:38.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:38.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:39.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:39.023+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:39.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:39.283+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:39.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:39.587+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:40.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:40.063+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:40.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:40.307+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:40.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:40.555+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:41.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:41.099+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:41.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:41.347+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:41.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:41.575+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:42.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:42.095+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:42.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:42.375+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:42.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:42.527+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:43.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:43.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:43.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:43.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:43.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:43.499+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:44.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:44.051+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:44.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:44.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:44.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:44.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:45.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:45.003+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:45.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:45.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:45.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:45.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:46.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:46.027+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:46.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:46.411+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:46.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:46.431+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:47.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:47.027+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:47.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:47.367+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:47.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:47.479+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:48.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:48.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:48.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:48.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:48.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:48.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:49.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:49.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:49.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:49.331+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:49.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:49.403+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:50.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:50.099+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:50.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:50.335+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:50.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:50.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:51.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:51.107+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:51.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:51.311+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:51.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:51.395+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:52.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:52.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:52.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:52.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:52.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:52.351+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:53.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:53.139+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:53.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:53.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:53.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:53.319+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:54.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:54.151+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:54.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:54.239+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:54.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:54.319+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:55.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:55.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:55.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:55.279+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:55.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:55.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:56.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:56.171+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:56.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:56.271+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:56.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:56.275+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:57.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:57.131+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:57.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:57.235+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:57.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:57.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:58.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:58.115+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:58.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:58.191+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:58.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:58.343+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:59.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:17:59.143+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:17:59.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:17:59.159+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:17:59.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:17:59.347+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:00.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:00.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:00.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:00.167+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:00.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:00.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:01.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:01.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:01.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:01.211+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:01.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:01.271+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:02.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:02.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:02.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:02.179+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:02.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:02.243+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:03.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:03.195+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:03.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:03.203+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:03.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:03.207+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:04.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:04.167+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:04.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:04.195+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:04.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:04.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:05.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:05.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:05.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:05.155+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:05.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:05.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:06.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:06.087+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:06.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:06.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:06.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:06.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:07.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:07.083+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:07.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:07.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:07.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:07.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:08.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:08.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:08.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:08.099+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:08.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:08.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:09.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:09.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:09.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:09.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:09.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:09.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:10.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:10.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:10.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:10.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:10.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:10.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:11.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:11.007+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:11.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:11.063+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:11.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:11.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:11.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:11.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:12.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:12.103+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:12.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:12.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:13.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:12.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:13.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:13.087+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:13.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:13.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:14.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:14.035+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:14.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:14.071+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:14.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:14.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:15.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:15.043+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:15.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:15.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:15.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:15.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:16.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:16.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:16.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:16.099+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:16.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:16.151+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:17.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:17.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:17.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:17.107+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:17.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:17.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:18.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:18.047+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:18.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:18.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:18.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:18.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:19.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:19.023+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:19.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:19.107+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:19.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:19.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:20.059 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:20.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:20.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:20.091+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:20.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:20.151+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:21.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:21.050+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:21.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:21.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:21.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:21.110+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:22.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:22.054+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:22.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:22.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:22.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:22.130+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:23.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:23.062+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:23.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:23.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:23.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:23.182+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:24.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:24.058+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:24.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:24.138+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:24.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:24.166+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:25.076 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:25.070+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:25.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:25.146+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:25.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:25.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:26.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:26.070+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:26.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:26.158+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:26.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:26.190+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:27.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:27.110+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:27.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:27.130+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:27.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:27.222+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:28.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:28.110+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:28.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:28.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:28.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:28.198+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:29.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:29.110+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:29.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:29.138+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:29.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:29.222+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:30.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:30.086+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:30.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:30.130+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:30.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:30.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:31.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:31.074+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:31.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:31.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:31.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:31.174+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:32.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:32.066+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:32.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:32.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:32.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:32.166+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:33.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:33.090+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:33.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:33.162+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:33.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:33.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:34.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:34.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:34.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:34.142+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:34.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:34.182+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:35.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:35.162+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:35.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:35.194+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:35.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:35.218+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:36.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:36.198+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:36.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:36.234+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:36.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:36.242+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:37.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:37.206+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:37.223 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:37.218+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:37.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:37.222+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:38.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:38.214+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:38.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:38.234+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:38.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:38.242+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:39.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:39.178+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:39.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:39.270+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:39.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:39.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:40.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:40.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:40.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:40.278+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:40.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:40.294+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:41.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:41.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:41.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:41.246+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:41.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:41.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:42.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:42.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:42.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:42.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:42.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:42.274+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:43.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:43.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:43.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:43.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:43.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:43.258+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:44.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:44.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:44.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:44.218+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:44.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:44.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:45.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:45.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:45.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:45.198+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:45.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:45.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:46.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:46.046+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:46.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:46.194+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:46.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:46.302+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:47.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:47.054+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:47.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:47.214+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:47.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:47.330+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:48.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:48.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:48.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:48.242+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:48.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:48.334+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:49.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:49.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:49.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:49.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:49.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:49.362+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:50.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:50.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:50.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:50.258+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:50.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:50.410+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:51.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:51.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:51.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:51.214+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:51.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:51.422+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:52.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:52.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:52.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:52.234+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:52.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:52.442+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:53.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:53.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:53.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:53.270+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:53.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:53.406+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:54.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:54.154+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:54.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:54.238+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:54.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:54.374+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:55.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:55.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:55.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:55.230+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:55.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:55.350+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:56.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:56.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:56.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:56.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:56.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:56.354+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:57.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:57.174+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:57.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:57.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:57.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:57.378+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:58.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:58.146+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:58.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:58.314+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:58.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:58.362+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:59.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:18:59.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:18:59.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:18:59.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:18:59.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:18:59.338+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:00.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:00.118+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:00.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:00.298+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:00.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:00.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:01.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:01.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:01.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:01.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:01.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:01.342+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:02.139 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:02.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:02.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:02.334+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:02.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:02.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:03.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:03.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:03.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:03.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:03.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:03.334+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:04.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:04.138+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:04.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:04.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:04.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:04.330+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:05.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:05.098+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:05.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:05.362+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:05.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:05.366+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:06.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:06.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:06.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:06.322+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:06.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:06.410+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:07.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:07.077+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:07.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:07.277+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:07.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:07.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:08.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:08.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:08.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:08.313+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:08.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:08.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:09.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:09.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:09.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:09.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:09.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:09.429+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:10.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:10.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:10.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:10.333+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:10.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:10.409+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:11.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:11.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:11.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:11.337+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:11.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:11.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:12.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:12.105+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:12.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:12.341+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:12.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:12.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:13.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:13.109+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:13.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:13.325+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:13.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:13.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:14.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:14.141+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:14.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:14.353+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:14.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:14.413+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:15.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:15.105+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:15.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:15.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:15.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:15.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:16.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:16.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:16.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:16.409+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:16.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:16.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:17.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:17.085+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:17.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:17.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:17.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:17.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:18.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:18.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:18.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:18.417+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:18.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:18.501+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:19.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:19.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:19.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:19.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:19.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:19.513+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:20.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:20.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:20.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:20.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:20.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:20.545+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:21.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:21.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:21.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:21.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:21.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:21.541+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:22.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:22.037+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:22.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:22.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:22.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:22.577+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:23.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:23.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:23.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:23.441+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:23.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:23.605+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:23.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:23.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:24.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:24.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:24.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:24.557+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:24.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:24.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:25.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:25.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:25.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:25.561+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:25.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:25.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:26.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:26.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:26.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:26.521+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:26.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:26.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:27.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:27.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:27.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:27.481+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:28.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:28.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:28.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:28.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:28.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:28.465+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:29.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:29.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:29.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:29.453+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:29.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:29.509+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:30.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:30.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:30.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:30.413+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:30.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:30.525+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:31.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:31.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:31.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:31.381+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:31.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:31.525+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:31.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:31.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:32.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:32.397+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:32.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:32.489+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:32.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:32.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:33.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:33.365+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:33.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:33.529+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:33.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:33.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:34.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:34.409+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:34.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:34.577+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:35.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:35.005+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:35.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:35.437+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:35.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:35.589+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:35.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:35.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:36.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:36.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:36.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:36.573+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:36.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:36.949+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:37.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:37.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:37.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:37.561+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:37.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:37.993+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:38.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:38.417+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:38.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:38.517+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:39.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:39.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:39.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:39.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:39.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:39.501+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:39.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:39.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:40.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:40.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:40.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:40.497+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:40.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:40.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:41.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:41.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:41.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:41.453+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:42.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:42.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:42.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:42.425+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:42.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:42.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:43.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:43.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:43.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:43.425+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:43.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:43.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:43.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:43.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:44.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:44.421+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:44.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:44.453+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:44.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:44.965+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:45.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:45.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:45.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:45.469+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:45.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:45.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:46.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:46.353+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:46.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:46.501+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:47.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:47.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:47.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:47.341+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:47.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:47.517+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:48.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:48.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:48.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:48.309+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:48.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:48.561+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:49.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:49.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:49.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:49.317+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:49.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:49.581+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:50.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:50.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:50.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:50.365+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:50.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:50.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:51.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:51.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:51.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:51.369+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:51.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:51.621+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:51.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:51.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:52.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:52.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:52.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:52.577+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:52.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:52.945+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:53.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:53.333+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:53.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:53.552+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:53.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:53.948+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:54.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:54.336+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:54.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:54.548+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:54.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:54.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:55.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:55.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:55.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:55.528+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:56.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:56.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:56.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:56.340+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:56.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:56.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:57.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:57.076+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:57.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:57.356+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:57.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:57.536+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:58.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:58.080+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:58.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:58.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:58.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:58.584+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:59.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:19:59.040+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:19:59.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:19:59.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:19:59.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:19:59.596+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:00.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:00.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:00.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:00.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:00.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:00.604+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:01.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:01.036+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:01.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:01.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:01.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:01.616+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:02.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:02.040+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:02.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:02.344+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:02.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:02.632+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:03.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:03.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:03.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:03.304+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:03.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:03.588+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:03.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:03.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:04.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:04.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:04.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:04.568+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:05.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:05.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:05.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:05.320+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:05.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:05.548+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:05.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:05.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:06.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:06.284+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:06.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:06.516+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:07.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:06.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:07.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:07.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:07.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:07.468+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:07.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:07.992+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:08.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:08.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:08.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:08.492+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:09.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:09.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:09.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:09.420+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:09.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:09.532+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:09.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:09.984+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:10.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:10.440+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:10.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:10.508+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:10.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:10.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:11.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:11.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:11.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:11.520+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:12.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:12.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:12.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:12.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:12.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:12.472+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:12.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:12.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:13.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:13.436+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:13.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:13.480+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:13.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:13.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:14.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:14.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:14.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:14.508+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:14.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:14.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:15.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:15.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:15.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:15.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:15.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:15.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:16.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:16.320+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:16.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:16.488+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:16.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:16.996+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:17.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:17.368+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:17.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:17.540+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:18.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:18.012+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:18.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:18.396+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:18.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:18.580+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:19.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:19.044+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:19.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:19.444+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:19.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:19.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:20.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:20.084+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:20.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:20.408+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:20.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:20.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:21.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:21.052+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:21.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:21.456+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:21.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:21.612+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:22.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:22.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:22.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:22.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:22.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:22.564+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:23.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:23.036+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:23.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:23.496+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:23.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:23.528+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:24.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:24.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:24.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:24.492+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:24.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:24.544+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:24.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:24.964+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:25.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:25.512+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:25.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:25.544+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:25.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:25.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:26.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:26.524+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:26.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:26.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:26.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:26.944+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:27.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:27.544+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:27.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:27.552+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:27.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:27.920+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:28.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:28.576+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:28.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:28.596+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:28.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:28.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:29.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:29.580+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:29.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:29.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:29.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:29.868+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:30.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:30.532+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:30.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:30.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:30.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:30.820+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:31.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:31.496+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:31.586 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:31.580+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:31.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:31.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:32.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:32.480+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:32.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:32.608+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:32.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:32.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:33.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:33.500+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:33.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:33.636+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:33.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:33.840+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:34.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:34.544+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:34.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:34.612+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:34.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:34.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:35.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:35.572+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:35.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:35.604+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:35.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:35.876+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:36.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:36.588+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:36.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:36.600+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:36.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:36.856+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:37.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:37.580+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:37.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:37.640+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:37.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:37.820+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:38.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:38.600+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:38.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:38.688+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:38.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:38.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:39.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:39.576+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:39.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:39.644+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:39.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:39.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:40.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:40.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:40.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:40.691+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:40.843 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:40.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:41.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:41.551+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:41.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:41.687+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:41.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:41.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:42.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:42.599+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:42.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:42.639+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:42.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:42.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:43.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:43.567+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:43.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:43.671+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:43.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:43.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:44.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:44.531+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:44.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:44.675+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:44.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:44.843+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:45.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:45.491+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:45.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:45.639+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:45.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:45.835+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:46.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:46.471+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:46.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:46.611+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:46.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:46.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:47.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:47.483+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:47.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:47.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:47.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:47.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:48.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:48.503+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:48.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:48.559+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:48.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:48.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:49.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:49.523+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:49.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:49.531+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:49.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:49.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:50.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:50.483+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:50.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:50.563+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:50.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:50.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:51.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:51.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:51.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:51.595+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:51.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:51.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:52.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:52.531+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:52.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:52.639+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:52.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:52.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:53.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:53.559+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:53.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:53.635+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:53.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:53.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:54.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:54.551+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:54.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:54.651+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:54.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:54.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:55.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:55.519+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:55.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:55.611+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:55.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:55.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:56.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:56.559+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:56.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:56.591+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:56.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:56.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:57.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:57.587+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:57.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:57.643+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:57.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:57.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:58.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:58.627+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:58.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:58.651+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:58.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:58.931+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:20:59.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:20:59.659+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:59.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:20:59.695+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:20:59.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:20:59.899+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:00.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:00.659+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:00.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:00.699+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:00.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:00.927+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:01.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:01.655+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:01.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:01.707+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:01.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:01.975+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:02.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:02.619+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:02.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:02.695+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:02.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:02.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:03.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:03.635+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:03.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:03.687+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:03.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:03.947+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:04.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:04.663+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:04.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:04.663+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:04.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:04.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:05.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:05.683+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:05.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:05.711+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:05.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:05.943+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:06.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:06.667+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:06.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:06.715+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:06.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:06.951+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:07.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:07.675+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:07.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:07.691+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:07.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:07.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:08.663 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:08.659+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:08.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:08.703+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:08.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:08.979+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:09.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:09.699+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:09.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:09.723+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:09.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:09.991+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:10.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:10.703+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:10.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:10.763+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:11.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:11.031+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:11.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:11.723+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:11.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:11.783+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:12.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:12.011+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:12.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:12.759+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:12.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:12.779+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:12.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:12.971+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:13.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:13.763+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:13.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:13.771+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:13.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:13.955+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:14.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:14.763+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:14.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:14.795+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:14.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:14.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:15.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:15.751+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:15.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:15.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:15.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:15.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:16.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:16.739+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:16.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:16.747+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:16.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:16.919+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:17.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:17.739+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:17.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:17.763+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:17.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:17.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:18.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:18.731+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:18.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:18.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:18.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:18.911+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:19.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:19.683+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:19.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:19.775+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:19.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:19.867+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:20.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:20.635+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:20.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:20.807+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:20.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:20.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:21.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:21.655+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:21.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:21.823+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:21.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:21.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:22.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:22.635+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:22.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:22.803+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:22.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:22.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:23.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:23.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:23.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:23.771+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:24.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:23.999+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:24.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:24.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:24.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:24.767+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:24.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:24.955+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:25.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:25.619+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:25.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:25.815+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:26.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:26.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:26.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:26.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:26.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:26.838+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:26.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:26.974+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:27.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:27.670+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:27.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:27.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:28.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:27.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:28.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:28.694+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:28.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:28.870+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:29.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:28.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:29.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:29.674+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:29.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:29.838+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:29.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:29.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:30.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:30.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:30.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:30.822+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:31.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:31.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:31.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:31.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:31.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:31.830+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:32.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:32.034+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:32.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:32.698+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:32.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:32.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:33.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:33.078+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:33.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:33.674+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:33.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:33.834+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:34.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:34.078+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:34.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:34.710+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:34.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:34.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:35.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:35.042+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:35.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:35.682+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:35.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:35.830+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:36.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:36.030+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:36.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:36.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:36.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:36.862+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:37.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:37.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:37.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:37.654+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:37.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:37.874+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:37.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:37.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:38.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:38.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:38.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:38.902+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:39.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:38.998+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:39.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:39.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:39.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:39.894+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:40.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:40.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:40.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:40.682+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:40.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:40.894+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:40.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:40.974+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:41.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:41.710+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:41.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:41.914+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:41.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:41.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:42.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:42.746+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:42.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:42.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:42.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:42.946+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:43.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:43.730+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:43.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:43.934+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:43.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:43.990+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:44.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:44.758+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:44.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:44.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:44.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:44.990+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:45.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:45.714+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:45.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:45.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:45.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:45.950+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:46.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:46.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:46.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:46.906+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:46.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:46.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:47.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:47.662+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:47.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:47.862+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:47.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:47.946+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:48.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:48.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:48.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:48.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:48.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:48.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:49.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:49.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:49.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:49.850+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:49.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:49.958+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:50.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:50.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:50.824 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:50.818+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:50.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:50.970+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:51.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:51.602+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:51.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:51.798+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:51.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:51.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:52.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:52.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:52.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:52.826+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:53.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:53.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:53.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:53.634+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:53.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:53.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:54.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:54.042+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:54.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:54.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:54.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:54.882+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:55.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:55.070+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:55.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:55.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:55.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:55.866+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:56.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:56.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:56.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:56.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:56.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:56.858+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:57.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:57.034+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:57.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:57.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:57.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:57.834+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:58.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:58.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:58.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:58.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:58.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:58.854+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:59.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:21:59.006+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:21:59.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:21:59.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:21:59.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:21:59.822+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:00.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:00.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:00.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:00.658+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:00.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:00.798+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:01.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:01.054+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:01.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:01.626+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:01.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:01.810+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:02.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:02.058+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:02.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:02.626+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:02.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:02.810+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:03.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:03.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:03.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:03.642+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:03.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:03.762+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:04.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:04.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:04.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:04.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:04.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:04.778+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:05.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:05.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:05.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:05.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:05.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:05.806+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:06.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:06.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:06.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:06.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:06.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:06.794+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:07.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:07.074+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:07.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:07.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:07.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:07.782+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:08.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:08.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:08.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:08.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:08.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:08.822+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:09.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:09.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:09.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:09.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:09.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:09.874+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:10.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:10.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:10.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:10.670+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:10.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:10.882+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:11.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:11.034+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:11.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:11.674+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:11.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:11.918+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:12.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:12.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:12.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:12.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:12.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:12.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:12.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:12.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:13.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:13.709+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:13.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:13.853+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:13.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:13.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:14.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:14.677+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:14.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:14.877+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:14.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:14.961+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:15.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:15.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:15.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:15.881+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:15.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:15.985+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:16.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:16.761+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:16.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:16.869+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:16.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:16.945+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:17.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:17.781+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:17.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:17.833+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:17.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:17.917+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:18.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:18.789+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:18.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:18.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:18.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:18.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:19.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:19.797+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:19.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:19.805+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:19.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:19.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:20.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:20.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:20.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:20.829+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:20.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:20.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:21.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:21.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:21.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:21.805+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:21.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:21.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:22.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:22.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:22.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:22.781+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:22.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:22.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:23.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:23.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:23.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:23.737+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:23.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:23.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:24.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:24.729+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:24.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:24.733+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:24.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:24.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:25.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:25.713+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:25.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:25.765+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:25.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:25.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:26.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:26.725+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:26.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:26.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:26.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:26.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:27.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:27.681+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:27.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:27.817+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:27.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:27.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:28.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:28.661+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:28.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:28.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:28.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:28.793+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:29.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:29.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:29.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:29.757+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:29.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:29.805+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:30.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:30.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:30.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:30.769+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:30.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:30.769+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:31.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:31.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:31.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:31.733+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:31.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:31.801+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:32.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:32.673+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:32.712 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:32.709+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:32.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:32.837+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:33.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:33.697+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:33.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:33.745+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:33.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:33.833+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:34.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:34.669+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:34.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:34.737+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:34.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:34.793+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:35.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:35.689+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:35.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:35.765+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:35.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:35.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:36.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:36.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:36.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:36.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:36.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:36.761+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:37.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:37.685+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:37.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:37.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:37.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:37.765+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:38.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:38.729+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:38.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:38.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:38.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:38.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:39.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:39.753+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:39.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:39.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:39.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:39.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:40.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:40.777+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:40.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:40.789+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:40.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:40.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:41.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:41.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:41.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:41.801+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:41.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:41.825+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:42.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:42.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:42.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:42.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:42.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:42.845+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:43.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:43.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:43.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:43.853+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:43.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:43.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:44.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:44.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:44.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:44.897+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:44.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:44.901+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:45.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:45.709+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:45.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:45.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:45.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:45.929+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:46.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:46.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:46.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:46.865+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:46.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:46.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:47.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:47.757+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:47.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:47.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:47.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:47.961+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:48.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:48.801+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:48.928 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:48.925+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:48.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:48.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:49.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:49.841+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:49.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:49.889+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:49.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:49.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:50.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:50.853+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:50.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:50.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:50.913 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:50.909+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:51.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:51.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:51.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:51.893+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:51.907 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:51.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:52.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:52.869+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:52.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:52.917+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:52.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:52.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:53.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:53.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:53.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:53.917+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:53.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:53.961+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:54.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:54.841+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:54.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:54.869+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:54.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:54.945+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:55.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:55.837+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:55.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:55.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:55.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:55.933+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:56.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:56.869+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:56.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:56.889+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:56.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:56.933+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:57.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:57.881+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:57.895 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:57.893+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:57.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:57.949+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:58.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:58.856+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:58.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:58.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:58.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:58.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:59.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:22:59.880+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:22:59.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:22:59.912+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:22:59.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:22:59.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:00.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:00.928+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:00.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:00.960+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:01.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:01.004+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:01.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:01.928+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:01.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:01.960+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:02.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:02.008+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:02.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:02.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:02.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:02.948+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:03.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:03.040+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:03.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:03.964+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:03.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:03.984+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:04.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:04.088+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:04.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:04.960+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:04.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:04.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:05.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:05.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:05.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:05.964+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:06.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:06.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:06.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:06.088+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:06.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:06.968+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:07.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:07.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:07.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:07.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:07.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:07.928+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:08.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:08.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:08.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:08.096+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:08.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:08.900+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:09.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:09.024+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:09.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:09.064+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:09.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:09.908+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:10.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:10.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:10.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:10.116+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:10.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:10.864+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:11.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:11.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:11.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:11.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:11.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:11.884+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:12.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:12.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:12.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:12.100+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:12.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:12.920+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:13.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:13.040+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:13.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:13.080+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:13.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:13.920+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:14.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:14.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:14.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:14.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:14.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:14.944+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:14.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:14.980+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:15.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:15.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:15.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:15.952+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:15.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:15.988+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:16.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:16.168+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:16.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:16.984+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:17.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:17.000+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:17.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:17.172+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:17.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:17.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:17.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:17.972+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:18.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:18.124+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:18.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:18.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:18.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:18.980+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:19.112 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:19.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:19.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:19.932+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:20.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:20.012+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:20.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:20.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:20.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:20.884+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:21.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:21.056+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:21.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:21.168+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:21.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:21.888+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:22.011 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:22.008+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:22.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:22.148+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:22.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:22.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:23.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:23.032+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:23.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:23.196+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:23.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:23.844+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:24.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:24.064+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:24.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:24.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:24.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:24.796+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:25.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:25.112+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:25.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:25.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:25.790 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:25.788+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:26.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:26.088+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:26.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:26.252+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:26.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:26.756+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:27.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:27.124+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:27.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:27.268+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:27.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:27.732+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:28.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:28.080+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:28.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:28.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:28.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:28.700+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:29.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:29.124+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:29.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:29.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:29.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:29.664+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:30.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:30.088+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:30.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:30.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:30.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:30.620+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:31.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:31.092+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:31.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:31.336+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:31.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:31.668+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:32.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:32.084+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:32.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:32.308+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:32.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:32.696+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:33.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:33.128+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:33.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:33.316+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:33.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:33.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:34.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:34.112+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:34.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:34.328+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:34.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:34.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:35.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:35.116+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:35.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:35.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:35.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:35.660+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:36.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:36.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:36.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:36.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:36.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:36.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:37.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:37.128+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:37.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:37.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:37.683 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:37.680+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:38.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:38.176+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:38.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:38.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:38.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:38.688+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:39.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:39.204+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:39.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:39.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:39.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:39.688+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:40.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:40.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:40.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:40.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:40.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:40.640+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:41.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:41.164+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:41.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:41.396+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:41.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:41.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:42.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:42.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:42.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:42.428+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:42.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:42.636+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:43.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:43.148+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:43.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:43.408+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:43.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:43.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:44.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:44.143+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:44.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:44.363+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:44.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:44.671+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:45.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:45.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:45.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:45.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:45.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:45.655+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:46.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:46.143+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:46.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:46.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:46.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:46.627+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:47.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:47.127+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:47.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:47.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:47.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:47.583+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:48.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:48.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:48.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:48.327+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:48.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:48.615+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:49.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:49.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:49.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:49.371+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:49.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:49.607+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:50.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:50.179+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:50.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:50.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:50.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:50.623+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:51.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:51.131+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:51.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:51.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:51.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:51.615+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:52.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:52.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:52.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:52.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:52.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:52.631+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:53.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:53.111+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:53.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:53.399+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:53.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:53.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:54.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:54.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:54.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:54.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:54.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:54.675+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:55.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:55.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:55.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:55.403+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:55.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:55.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:56.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:56.179+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:56.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:56.427+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:56.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:56.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:57.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:57.131+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:57.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:57.427+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:57.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:57.687+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:58.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:58.151+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:58.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:58.399+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:58.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:58.719+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:23:59.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:23:59.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:59.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:23:59.355+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:23:59.764 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:23:59.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:00.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:00.131+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:00.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:00.339+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:00.727 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:00.723+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:01.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:01.131+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:01.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:01.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:01.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:01.735+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:02.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:02.151+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:02.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:02.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:02.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:02.699+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:03.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:03.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:03.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:03.387+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:03.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:03.683+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:04.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:04.207+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:04.350 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:04.343+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:04.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:04.703+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:05.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:05.175+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:05.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:05.387+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:05.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:05.739+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:06.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:06.183+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:06.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:06.343+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:06.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:06.711+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:07.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:07.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:07.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:07.367+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:07.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:07.747+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:08.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:08.219+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:08.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:08.399+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:08.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:08.767+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:09.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:09.215+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:09.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:09.439+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:09.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:09.807+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:10.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:10.187+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:10.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:10.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:10.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:10.763+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:11.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:11.159+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:11.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:11.423+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:11.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:11.767+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:12.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:12.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:12.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:12.395+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:12.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:12.767+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:13.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:13.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:13.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:13.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:13.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:13.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:14.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:14.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:14.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:14.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:14.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:14.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:15.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:15.155+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:15.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:15.391+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:15.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:15.779+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:16.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:16.135+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:16.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:16.415+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:16.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:16.771+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:17.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:17.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:17.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:17.455+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:17.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:17.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:18.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:18.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:18.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:18.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:18.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:18.871+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:19.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:19.119+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:19.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:19.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:19.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:19.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:20.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:20.167+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:20.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:20.447+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:20.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:20.839+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:21.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:21.123+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:21.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:21.495+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:21.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:21.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:22.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:22.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:22.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:22.451+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:22.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:22.835+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:23.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:23.083+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:23.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:23.443+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:23.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:23.883+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:24.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:24.115+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:24.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:24.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:24.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:24.891+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:25.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:25.103+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:25.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:25.423+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:25.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:25.935+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:26.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:26.091+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:26.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:26.379+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:26.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:26.963+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:27.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:27.139+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:27.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:27.347+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:27.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:27.987+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:28.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:28.111+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:28.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:28.311+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:29.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:29.015+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:29.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:29.143+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:29.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:29.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:30.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:30.042+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:30.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:30.134+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:30.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:30.230+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:30.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:30.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:31.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:31.118+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:31.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:31.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:32.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:32.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:32.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:32.166+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:32.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:32.170+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:32.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:32.994+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:33.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:33.138+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:33.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:33.194+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:34.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:34.038+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:34.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:34.118+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:34.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:34.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:35.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:35.018+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:35.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:35.078+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:35.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:35.198+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:36.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:36.030+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:36.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:36.074+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:36.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:36.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:37.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:37.046+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:37.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:37.082+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:37.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:37.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:38.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:38.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:38.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:38.126+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:38.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:38.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:39.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:39.050+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:39.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:39.090+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:39.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:39.174+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:40.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:40.066+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:40.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:40.086+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:40.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:40.190+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:41.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:41.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:41.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:41.098+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:41.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:41.170+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:42.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:42.062+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:42.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:42.102+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:42.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:42.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:43.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:43.106+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:43.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:43.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:43.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:43.178+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:44.076 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:44.070+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:44.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:44.130+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:44.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:44.218+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:45.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:45.114+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:45.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:45.138+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:45.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:45.222+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:46.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:46.066+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:46.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:46.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:46.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:46.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:47.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:47.094+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:47.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:47.150+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:47.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:47.238+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:48.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:48.102+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:48.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:48.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:48.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:48.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:49.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:49.126+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:49.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:49.166+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:49.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:49.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:50.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:50.130+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:50.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:50.150+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:50.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:50.258+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:51.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:51.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:51.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:51.126+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:51.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:51.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:52.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:52.110+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:52.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:52.146+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:52.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:52.334+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:53.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:53.134+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:53.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:53.182+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:53.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:53.346+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:54.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:54.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:54.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:54.154+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:54.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:54.334+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:55.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:55.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:55.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:55.182+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:55.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:55.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:56.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:56.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:56.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:56.182+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:56.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:56.290+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:57.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:57.022+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:57.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:57.162+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:57.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:57.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:57.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:57.986+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:58.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:58.114+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:58.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:58.290+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:58.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:58.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:24:59.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:24:59.146+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:59.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:24:59.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:24:59.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:24:59.910+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:00.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:00.110+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:00.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:00.282+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:00.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:00.930+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:01.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:01.078+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:01.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:01.326+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:01.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:01.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:02.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:02.094+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:02.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:02.330+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:02.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:02.930+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:03.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:03.126+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:03.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:03.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:03.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:03.906+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:04.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:04.114+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:04.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:04.366+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:04.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:04.926+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:05.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:05.118+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:05.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:05.402+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:05.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:05.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:06.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:06.114+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:06.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:06.402+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:06.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:06.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:07.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:07.102+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:07.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:07.390+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:07.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:07.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:08.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:08.154+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:08.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:08.406+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:08.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:08.922+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:09.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:09.142+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:09.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:09.382+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:09.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:09.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:10.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:10.178+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:10.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:10.422+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:10.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:10.954+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:11.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:11.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:11.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:11.402+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:12.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:12.002+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:12.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:12.178+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:12.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:12.442+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:12.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:12.990+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:13.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:13.166+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:13.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:13.410+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:13.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:13.954+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:14.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:14.126+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:14.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:14.394+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:14.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:14.970+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:15.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:15.146+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:15.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:15.426+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:16.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:16.021+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:16.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:16.129+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:16.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:16.381+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:17.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:17.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:17.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:17.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:17.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:17.357+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:18.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:18.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:18.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:18.153+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:18.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:18.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:19.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:18.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:19.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:19.113+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:19.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:19.337+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:20.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:19.997+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:20.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:20.141+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:20.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:20.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:21.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:21.037+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:21.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:21.109+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:21.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:21.269+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:22.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:22.037+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:22.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:22.101+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:22.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:22.297+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:23.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:23.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:23.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:23.113+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:23.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:23.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:24.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:24.081+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:24.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:24.097+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:24.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:24.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:25.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:25.065+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:25.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:25.085+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:25.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:25.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:26.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:26.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:26.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:26.113+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:26.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:26.257+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:27.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:27.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:27.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:27.121+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:27.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:27.225+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:28.059 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:28.057+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:28.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:28.097+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:28.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:28.241+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:29.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:29.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:29.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:29.141+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:29.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:29.281+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:30.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:30.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:30.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:30.161+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:30.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:30.245+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:31.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:31.053+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:31.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:31.177+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:31.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:31.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:32.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:32.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:32.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:32.165+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:32.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:32.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:33.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:33.025+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:33.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:33.153+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:33.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:33.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:34.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:34.077+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:34.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:34.157+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:34.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:34.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:35.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:35.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:35.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:35.133+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:35.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:35.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:36.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:36.013+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:36.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:36.129+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:36.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:36.133+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:36.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:36.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:37.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:37.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:37.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:37.181+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:37.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:37.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:38.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:38.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:38.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:38.205+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:38.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:38.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:39.066 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:39.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:39.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:39.209+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:39.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:39.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:40.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:40.021+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:40.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:40.217+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:40.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:40.953+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:40.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:40.977+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:41.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:41.185+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:41.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:41.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:42.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:42.005+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:42.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:42.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:42.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:42.957+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:43.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:43.053+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:43.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:43.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:43.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:43.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:44.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:44.025+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:44.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:44.161+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:44.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:44.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:45.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:45.001+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:45.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:45.149+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:45.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:45.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:46.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:46.033+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:46.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:46.193+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:46.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:46.917+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:47.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:47.037+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:47.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:47.205+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:47.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:47.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:48.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:48.077+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:48.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:48.241+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:48.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:48.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:49.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:49.065+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:49.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:49.269+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:49.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:49.869+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:50.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:50.089+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:50.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:50.309+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:50.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:50.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:51.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:51.081+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:51.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:51.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:51.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:51.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:52.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:52.041+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:52.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:52.269+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:52.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:52.973+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:53.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:53.069+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:53.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:53.241+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:53.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:53.989+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:54.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:54.113+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:54.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:54.237+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:54.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:54.945+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:55.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:55.093+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:55.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:55.205+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:55.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:55.969+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:56.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:56.141+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:56.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:56.249+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:56.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:56.929+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:57.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:57.165+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:57.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:57.245+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:57.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:57.913+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:58.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:58.197+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:58.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:58.237+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:58.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:58.885+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:25:59.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:25:59.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:59.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:25:59.285+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:25:59.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:25:59.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:00.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:00.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:00.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:00.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:00.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:00.809+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:01.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:01.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:01.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:01.285+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:01.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:01.836+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:02.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:02.224+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:02.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:02.260+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:02.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:02.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:03.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:03.228+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:03.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:03.296+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:03.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:03.784+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:04.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:04.232+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:04.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:04.284+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:04.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:04.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:05.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:05.280+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:05.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:05.284+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:05.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:05.784+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:06.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:06.280+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:06.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:06.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:06.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:06.808+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:07.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:07.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:07.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:07.324+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:07.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:07.832+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:08.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:08.248+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:08.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:08.312+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:08.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:08.800+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:09.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:09.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:09.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:09.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:09.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:09.764+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:10.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:10.320+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:10.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:10.324+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:10.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:10.768+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:11.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:11.300+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:11.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:11.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:11.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:11.776+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:12.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:12.268+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:12.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:12.288+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:12.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:12.776+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:13.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:13.244+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:13.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:13.288+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:13.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:13.768+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:14.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:14.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:14.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:14.264+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:14.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:14.732+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:15.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:15.224+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:15.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:15.240+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:15.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:15.692+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:16.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:16.220+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:16.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:16.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:16.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:16.712+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:17.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:17.212+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:17.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:17.232+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:17.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:17.692+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:18.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:18.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:18.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:18.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:18.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:18.700+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:19.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:19.216+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:19.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:19.236+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:19.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:19.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:20.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:20.208+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:20.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:20.244+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:20.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:20.664+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:21.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:21.168+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:21.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:21.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:21.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:21.680+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:22.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:22.216+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:22.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:22.260+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:22.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:22.672+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:23.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:23.220+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:23.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:23.260+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:23.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:23.636+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:24.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:24.192+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:24.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:24.228+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:24.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:24.604+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:25.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:25.212+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:25.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:25.244+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:25.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:25.576+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:26.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:26.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:26.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:26.236+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:26.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:26.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:27.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:27.176+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:27.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:27.276+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:27.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:27.600+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:28.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:28.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:28.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:28.256+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:28.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:28.548+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:29.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:29.224+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:29.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:29.296+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:29.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:29.592+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:30.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:30.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:30.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:30.292+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:30.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:30.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:31.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:31.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:31.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:31.268+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:31.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:31.556+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:32.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:32.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:32.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:32.260+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:32.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:32.540+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:33.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:33.220+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:33.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:33.272+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:33.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:33.576+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:34.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:34.204+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:34.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:34.240+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:34.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:34.540+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:35.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:35.168+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:35.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:35.228+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:35.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:35.560+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:36.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:36.144+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:36.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:36.184+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:36.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:36.572+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:37.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:37.148+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:37.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:37.160+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:37.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:37.592+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:38.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:38.112+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:38.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:38.144+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:38.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:38.628+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:39.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:39.088+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:39.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:39.120+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:39.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:39.636+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:40.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:40.080+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:40.110 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:40.108+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:40.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:40.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:41.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:41.032+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:41.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:41.156+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:41.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:41.656+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:42.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:42.040+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:42.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:42.120+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:42.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:42.612+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:43.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:43.064+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:43.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:43.084+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:43.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:43.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:44.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:44.100+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:44.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:44.120+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:44.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:44.628+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:45.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:45.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:45.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:45.128+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:45.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:45.620+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:46.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:46.092+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:46.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:46.144+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:46.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:46.592+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:47.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:47.076+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:47.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:47.176+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:47.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:47.579+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:48.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:48.107+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:48.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:48.155+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:48.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:48.603+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:49.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:49.091+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:49.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:49.147+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:49.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:49.595+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:50.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:50.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:50.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:50.195+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:50.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:50.611+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:51.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:51.051+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:51.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:51.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:51.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:51.591+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:52.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:52.031+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:52.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:52.171+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:52.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:52.595+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:53.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:53.007+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:53.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:53.211+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:53.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:53.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:53.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:53.971+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:54.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:54.163+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:54.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:54.671+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:54.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:54.975+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:55.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:55.175+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:55.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:55.627+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:56.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:55.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:56.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:56.191+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:56.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:56.671+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:57.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:57.047+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:57.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:57.151+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:57.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:57.707+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:58.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:58.023+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:58.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:58.147+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:58.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:58.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:26:59.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:59.019+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:59.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:26:59.175+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:26:59.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:26:59.643+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:00.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:26:59.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:00.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:00.207+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:00.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:00.683+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:00.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:00.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:01.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:01.243+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:01.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:01.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:01.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:01.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:02.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:02.235+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:02.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:02.711+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:02.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:02.923+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:03.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:03.219+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:03.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:03.715+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:03.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:03.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:04.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:04.235+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:04.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:04.683+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:04.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:04.911+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:05.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:05.267+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:05.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:05.659+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:05.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:05.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:06.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:06.251+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:06.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:06.631+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:07.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:06.999+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:07.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:07.271+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:07.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:07.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:07.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:07.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:08.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:08.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:08.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:08.603+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:08.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:08.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:09.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:09.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:09.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:09.631+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:09.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:09.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:10.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:10.331+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:10.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:10.627+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:10.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:10.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:11.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:11.291+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:11.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:11.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:11.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:11.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:12.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:12.271+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:12.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:12.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:13.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:12.999+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:13.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:13.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:13.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:13.667+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:13.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:13.971+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:14.285 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:14.279+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:14.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:14.683+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:14.943 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:14.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:15.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:15.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:15.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:15.639+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:15.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:15.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:16.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:16.283+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:16.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:16.635+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:16.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:16.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:17.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:17.263+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:17.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:17.655+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:18.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:18.035+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:18.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:18.251+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:18.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:18.699+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:19.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:19.047+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:19.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:19.247+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:19.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:19.707+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:20.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:20.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:20.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:20.271+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:20.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:20.751+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:21.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:21.063+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:21.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:21.307+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:21.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:21.767+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:22.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:22.087+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:22.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:22.307+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:22.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:22.751+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:23.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:23.131+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:23.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:23.347+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:23.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:23.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:24.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:24.135+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:24.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:24.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:24.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:24.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:25.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:25.175+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:25.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:25.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:25.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:25.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:26.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:26.163+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:26.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:26.343+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:26.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:26.747+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:27.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:27.203+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:27.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:27.387+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:27.774 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:27.767+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:28.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:28.199+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:28.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:28.347+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:28.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:28.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:29.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:29.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:29.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:29.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:29.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:29.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:30.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:30.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:30.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:30.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:30.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:30.835+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:31.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:31.171+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:31.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:31.359+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:31.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:31.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:32.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:32.219+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:32.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:32.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:32.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:32.875+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:33.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:33.258+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:33.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:33.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:33.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:33.858+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:34.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:34.230+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:34.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:34.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:34.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:34.830+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:35.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:35.210+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:35.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:35.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:35.809 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:35.802+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:36.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:36.210+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:36.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:36.294+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:36.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:36.766+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:37.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:37.226+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:37.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:37.254+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:37.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:37.730+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:38.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:38.206+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:38.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:38.210+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:38.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:38.714+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:39.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:39.206+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:39.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:39.258+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:39.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:39.734+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:40.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:40.234+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:40.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:40.278+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:40.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:40.686+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:41.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:41.254+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:41.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:41.306+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:41.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:41.706+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:42.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:42.266+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:42.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:42.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:42.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:42.722+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:43.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:43.246+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:43.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:43.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:43.723 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:43.718+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:44.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:44.254+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:44.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:44.286+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:44.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:44.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:45.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:45.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:45.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:45.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:45.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:45.774+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:46.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:46.246+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:46.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:46.262+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:46.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:46.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:47.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:47.266+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:47.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:47.266+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:47.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:47.862+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:48.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:48.214+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:48.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:48.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:48.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:48.830+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:49.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:49.226+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:49.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:49.258+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:49.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:49.862+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:50.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:50.218+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:50.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:50.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:50.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:50.890+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:51.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:51.242+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:51.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:51.258+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:51.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:51.922+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:52.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:52.250+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:52.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:52.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:52.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:52.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:53.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:53.222+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:53.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:53.298+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:53.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:53.930+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:54.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:54.210+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:54.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:54.274+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:54.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:54.942+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:55.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:55.222+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:55.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:55.286+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:55.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:55.938+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:56.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:56.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:56.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:56.306+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:56.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:56.970+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:57.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:57.190+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:57.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:57.310+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:58.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:58.010+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:58.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:58.214+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:58.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:58.306+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:59.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:59.014+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:27:59.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:27:59.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:59.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:27:59.322+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:27:59.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:27:59.966+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:00.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:00.230+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:00.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:00.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:00.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:00.978+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:01.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:01.246+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:01.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:01.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:02.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:02.030+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:02.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:02.254+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:02.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:02.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:03.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:03.058+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:03.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:03.278+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:03.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:03.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:04.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:04.106+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:04.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:04.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:04.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:04.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:05.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:05.090+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:05.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:05.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:05.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:05.298+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:06.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:06.050+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:06.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:06.290+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:06.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:06.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:07.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:07.054+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:07.285 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:07.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:07.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:07.306+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:08.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:08.102+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:08.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:08.278+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:08.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:08.290+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:09.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:09.126+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:09.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:09.270+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:09.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:09.298+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:10.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:10.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:10.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:10.314+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:10.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:10.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:11.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:11.094+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:11.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:11.294+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:11.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:11.362+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:12.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:12.066+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:12.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:12.294+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:12.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:12.318+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:13.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:13.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:13.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:13.298+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:13.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:13.338+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:14.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:14.150+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:14.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:14.294+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:14.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:14.342+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:15.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:15.158+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:15.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:15.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:15.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:15.358+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:16.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:16.142+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:16.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:16.230+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:16.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:16.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:17.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:17.114+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:17.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:17.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:17.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:17.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:18.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:18.122+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:18.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:18.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:18.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:18.474+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:19.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:19.137+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:19.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:19.141+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:19.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:19.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:20.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:20.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:20.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:20.185+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:20.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:20.409+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:21.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:21.097+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:21.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:21.217+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:21.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:21.389+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:22.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:22.109+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:22.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:22.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:22.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:22.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:23.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:23.117+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:23.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:23.177+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:23.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:23.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:24.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:24.073+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:24.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:24.209+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:24.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:24.429+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:25.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:25.077+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:25.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:25.225+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:25.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:25.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:26.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:26.101+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:26.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:26.261+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:26.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:26.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:27.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:27.069+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:27.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:27.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:27.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:27.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:28.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:28.105+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:28.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:28.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:28.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:28.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:29.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:29.129+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:29.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:29.305+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:29.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:29.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:30.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:30.141+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:30.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:30.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:30.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:30.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:31.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:31.145+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:31.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:31.325+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:31.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:31.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:32.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:32.181+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:32.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:32.329+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:32.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:32.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:33.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:33.185+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:33.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:33.309+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:33.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:33.493+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:34.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:34.161+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:34.281 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:34.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:34.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:34.529+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:35.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:35.137+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:35.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:35.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:35.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:35.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:36.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:36.141+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:36.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:36.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:36.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:36.557+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:37.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:37.157+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:37.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:37.317+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:37.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:37.517+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:38.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:38.169+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:38.317 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:38.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:38.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:38.533+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:39.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:39.189+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:39.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:39.345+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:39.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:39.497+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:40.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:40.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:40.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:40.313+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:40.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:40.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:41.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:41.229+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:41.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:41.325+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:41.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:41.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:42.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:42.225+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:42.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:42.329+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:42.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:42.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:43.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:43.189+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:43.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:43.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:43.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:43.473+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:44.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:44.201+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:44.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:44.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:44.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:44.481+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:45.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:45.237+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:45.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:45.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:45.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:45.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:46.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:46.193+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:46.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:46.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:46.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:46.421+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:47.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:47.241+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:47.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:47.349+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:47.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:47.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:48.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:48.253+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:48.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:48.329+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:48.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:48.401+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:49.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:49.285+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:49.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:49.317+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:49.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:49.425+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:50.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:50.305+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:50.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:50.309+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:50.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:50.389+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:51.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:51.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:51.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:51.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:51.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:51.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:52.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:52.353+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:52.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:52.373+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:52.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:52.421+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:53.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:53.353+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:53.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:53.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:53.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:53.409+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:54.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:54.329+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:54.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:54.345+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:54.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:54.453+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:55.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:55.305+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:55.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:55.361+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:55.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:55.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:56.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:56.349+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:56.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:56.393+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:56.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:56.449+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:57.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:57.373+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:57.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:57.389+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:57.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:57.437+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:58.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:58.337+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:58.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:58.397+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:58.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:58.473+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:59.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:28:59.357+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:28:59.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:28:59.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:28:59.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:28:59.433+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:00.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:00.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:00.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:00.409+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:00.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:00.449+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:01.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:01.377+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:01.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:01.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:01.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:01.493+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:02.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:02.397+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:02.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:02.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:02.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:02.493+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:03.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:03.361+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:03.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:03.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:03.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:03.513+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:04.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:04.345+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:04.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:04.453+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:04.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:04.473+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:05.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:05.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:05.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:05.440+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:05.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:05.448+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:06.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:06.288+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:06.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:06.404+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:06.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:06.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:07.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:07.308+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:07.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:07.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:07.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:07.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:08.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:08.340+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:08.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:08.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:08.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:08.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:09.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:09.340+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:09.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:09.372+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:09.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:09.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:10.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:10.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:10.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:10.384+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:10.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:10.432+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:11.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:11.364+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:11.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:11.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:11.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:11.448+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:12.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:12.320+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:12.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:12.404+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:12.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:12.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:13.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:13.292+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:13.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:13.372+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:13.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:13.452+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:14.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:14.260+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:14.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:14.340+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:14.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:14.412+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:15.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:15.216+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:15.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:15.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:15.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:15.456+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:16.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:16.240+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:16.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:16.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:16.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:16.484+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:17.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:17.264+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:17.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:17.284+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:17.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:17.480+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:18.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:18.296+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:18.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:18.332+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:18.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:18.492+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:19.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:19.268+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:19.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:19.316+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:19.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:19.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:20.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:20.256+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:20.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:20.352+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:20.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:20.496+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:21.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:21.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:21.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:21.348+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:21.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:21.460+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:22.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:22.212+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:22.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:22.368+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:22.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:22.480+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:23.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:23.224+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:23.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:23.392+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:23.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:23.484+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:24.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:24.232+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:24.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:24.432+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:24.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:24.488+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:25.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:25.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:25.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:25.436+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:25.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:25.444+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:26.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:26.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:26.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:26.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:26.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:26.448+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:27.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:27.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:27.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:27.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:27.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:27.444+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:28.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:28.128+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:28.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:28.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:28.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:28.420+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:29.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:29.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:29.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:29.328+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:29.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:29.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:30.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:30.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:30.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:30.372+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:30.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:30.420+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:31.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:31.236+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:31.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:31.340+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:31.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:31.412+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:32.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:32.252+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:32.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:32.384+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:32.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:32.408+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:33.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:33.264+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:33.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:33.436+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:33.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:33.452+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:34.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:34.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:34.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:34.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:34.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:34.428+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:35.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:35.292+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:35.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:35.380+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:35.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:35.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:36.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:36.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:36.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:36.356+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:36.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:36.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:37.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:37.284+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:37.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:37.356+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:37.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:37.404+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:38.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:38.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:38.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:38.348+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:38.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:38.400+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:39.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:39.288+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:39.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:39.320+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:39.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:39.424+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:40.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:40.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:40.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:40.372+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:40.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:40.376+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:41.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:41.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:41.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:41.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:41.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:41.416+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:42.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:42.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:42.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:42.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:42.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:42.408+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:43.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:43.336+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:43.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:43.388+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:43.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:43.404+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:44.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:44.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:44.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:44.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:44.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:44.416+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:45.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:45.368+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:45.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:45.372+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:45.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:45.388+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:46.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:46.360+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:46.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:46.368+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:46.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:46.368+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:47.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:47.316+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:47.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:47.400+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:47.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:47.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:48.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:48.328+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:48.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:48.364+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:48.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:48.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:49.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:49.348+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:49.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:49.368+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:49.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:49.412+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:50.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:50.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:50.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:50.332+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:50.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:50.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:51.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:51.280+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:51.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:51.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:51.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:51.396+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:52.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:52.328+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:52.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:52.344+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:52.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:52.388+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:53.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:53.336+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:53.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:53.356+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:53.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:53.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:54.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:54.324+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:54.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:54.356+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:54.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:54.443+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:55.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:55.307+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:55.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:55.331+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:55.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:55.407+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:56.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:56.263+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:56.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:56.323+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:56.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:56.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:57.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:57.267+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:57.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:57.371+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:57.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:57.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:58.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:58.291+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:58.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:58.399+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:58.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:58.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:59.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:29:59.311+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:29:59.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:29:59.431+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:29:59.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:29:59.451+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:00.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:00.303+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:00.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:00.403+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:00.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:00.427+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:01.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:01.283+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:01.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:01.355+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:01.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:01.455+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:02.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:02.275+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:02.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:02.343+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:02.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:02.467+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:03.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:03.299+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:03.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:03.319+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:03.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:03.435+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:04.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:04.259+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:04.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:04.331+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:04.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:04.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:05.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:05.239+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:05.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:05.323+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:05.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:05.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:06.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:06.219+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:06.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:06.331+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:06.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:06.395+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:07.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:07.227+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:07.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:07.363+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:07.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:07.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:08.249 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:08.243+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:08.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:08.339+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:08.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:08.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:09.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:09.271+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:09.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:09.291+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:09.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:09.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:10.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:10.255+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:10.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:10.255+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:10.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:10.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:11.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:11.223+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:11.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:11.227+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:11.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:11.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:12.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:12.187+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:12.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:12.187+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:12.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:12.419+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:13.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:13.143+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:13.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:13.151+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:13.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:13.387+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:14.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:14.111+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:14.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:14.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:14.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:14.375+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:15.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:15.087+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:15.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:15.159+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:15.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:15.419+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:16.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:16.119+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:16.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:16.123+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:16.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:16.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:17.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:17.127+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:17.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:17.159+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:17.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:17.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:18.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:18.147+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:18.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:18.195+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:18.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:18.447+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:19.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:19.123+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:19.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:19.175+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:19.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:19.427+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:20.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:20.099+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:20.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:20.135+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:20.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:20.423+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:21.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:21.067+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:21.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:21.179+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:21.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:21.463+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:22.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:22.035+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:22.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:22.155+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:22.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:22.483+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:22.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:22.987+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:23.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:23.167+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:23.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:23.439+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:23.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:23.963+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:24.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:24.135+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:24.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:24.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:24.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:24.987+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:25.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:25.095+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:25.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:25.383+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:25.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:25.987+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:26.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:26.135+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:26.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:26.423+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:26.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:26.975+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:27.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:27.091+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:27.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:27.387+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:28.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:27.995+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:28.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:28.083+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:28.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:28.415+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:28.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:28.959+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:29.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:29.051+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:29.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:29.407+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:29.996 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:29.991+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:30.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:30.019+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:30.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:30.383+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:30.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:30.947+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:31.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:31.051+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:31.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:31.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:31.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:31.903+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:32.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:32.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:32.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:32.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:32.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:32.939+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:33.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:33.063+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:33.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:33.319+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:33.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:33.931+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:34.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:34.091+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:34.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:34.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:34.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:34.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:35.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:35.055+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:35.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:35.263+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:35.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:35.967+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:36.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:36.071+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:36.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:36.275+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:36.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:36.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:37.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:37.063+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:37.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:37.243+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:37.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:37.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:38.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:38.051+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:38.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:38.203+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:38.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:38.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:39.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:39.067+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:39.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:39.207+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:39.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:39.951+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:40.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:40.039+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:40.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:40.227+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:40.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:40.975+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:41.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:40.995+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:41.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:41.227+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:41.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:41.955+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:41.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:41.955+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:42.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:42.275+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:42.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:42.943+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:42.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:42.967+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:43.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:43.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:43.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:43.918+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:43.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:43.930+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:44.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:44.270+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:44.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:44.866+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:44.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:44.978+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:45.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:45.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:45.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:45.850+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:45.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:45.950+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:46.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:46.238+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:46.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:46.806+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:46.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:46.922+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:47.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:47.218+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:47.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:47.826+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:47.979 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:47.974+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:48.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:48.190+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:48.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:48.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:49.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:49.014+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:49.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:49.190+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:49.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:49.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:50.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:50.050+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:50.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:50.210+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:50.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:50.798+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:51.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:51.042+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:51.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:51.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:51.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:51.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:52.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:52.026+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:52.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:52.226+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:52.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:52.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:53.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:53.030+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:53.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:53.194+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:53.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:53.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:54.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:54.042+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:54.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:54.214+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:54.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:54.878+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:55.027 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:55.022+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:55.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:55.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:55.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:55.902+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:56.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:56.018+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:56.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:56.170+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:56.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:56.898+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:57.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:56.998+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:57.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:57.186+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:57.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:57.886+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:58.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:58.026+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:58.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:58.198+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:58.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:58.890+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:30:59.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:30:59.062+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:59.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:30:59.238+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:30:59.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:30:59.854+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:00.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:00.030+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:00.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:00.198+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:00.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:00.810+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:01.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:01.070+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:01.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:01.190+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:01.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:01.790+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:02.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:02.066+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:02.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:02.182+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:02.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:02.822+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:03.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:03.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:03.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:03.226+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:03.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:03.786+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:04.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:04.126+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:04.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:04.266+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:04.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:04.778+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:05.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:05.134+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:05.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:05.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:05.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:05.802+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:06.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:06.122+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:06.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:06.282+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:06.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:06.754+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:07.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:07.114+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:07.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:07.314+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:07.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:07.742+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:08.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:08.086+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:08.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:08.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:08.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:08.738+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:09.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:09.078+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:09.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:09.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:09.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:09.706+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:10.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:10.114+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:10.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:10.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:10.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:10.710+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:11.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:11.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:11.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:11.354+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:11.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:11.666+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:12.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:12.198+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:12.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:12.406+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:12.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:12.662+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:13.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:13.190+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:13.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:13.438+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:13.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:13.626+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:14.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:14.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:14.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:14.450+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:14.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:14.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:15.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:15.206+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:15.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:15.474+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:15.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:15.626+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:16.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:16.246+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:16.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:16.446+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:16.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:16.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:17.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:17.238+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:17.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:17.482+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:17.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:17.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:18.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:18.222+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:18.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:18.478+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:18.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:18.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:19.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:19.230+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:19.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:19.530+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:19.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:19.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:20.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:20.262+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:20.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:20.518+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:20.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:20.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:21.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:21.218+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:21.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:21.530+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:21.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:21.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:22.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:22.186+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:22.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:22.530+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:22.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:22.558+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:23.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:23.194+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:23.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:23.542+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:23.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:23.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:24.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:24.162+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:24.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:24.518+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:24.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:24.650+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:25.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:25.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:25.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:25.490+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:25.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:25.658+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:26.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:26.174+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:26.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:26.502+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:26.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:26.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:27.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:27.214+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:27.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:27.522+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:27.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:27.682+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:28.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:28.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:28.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:28.526+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:28.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:28.690+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:29.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:29.238+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:29.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:29.534+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:29.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:29.718+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:30.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:30.234+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:30.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:30.522+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:30.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:30.766+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:31.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:31.250+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:31.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:31.478+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:31.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:31.810+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:32.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:32.258+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:32.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:32.525+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:32.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:32.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:33.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:33.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:33.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:33.561+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:33.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:33.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:34.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:34.253+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:34.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:34.605+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:34.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:34.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:35.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:35.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:35.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:35.653+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:35.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:35.833+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:36.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:36.301+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:36.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:36.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:36.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:36.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:37.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:37.265+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:37.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:37.681+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:37.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:37.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:38.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:38.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:38.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:38.697+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:38.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:38.833+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:39.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:39.285+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:39.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:39.713+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:39.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:39.793+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:40.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:40.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:40.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:40.677+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:40.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:40.801+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:41.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:41.281+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:41.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:41.729+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:41.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:41.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:42.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:42.321+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:42.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:42.753+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:42.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:42.821+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:43.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:43.289+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:43.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:43.749+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:43.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:43.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:44.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:44.273+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:44.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:44.777+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:44.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:44.797+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:45.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:45.277+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:45.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:45.741+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:45.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:45.813+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:46.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:46.249+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:46.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:46.737+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:46.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:46.829+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:47.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:47.221+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:47.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:47.781+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:47.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:47.849+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:48.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:48.201+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:48.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:48.809+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:48.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:48.861+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:49.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:49.213+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:49.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:49.761+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:49.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:49.889+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:50.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:50.181+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:50.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:50.797+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:50.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:50.905+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:51.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:51.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:51.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:51.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:51.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:51.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:52.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:52.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:52.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:52.865+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:52.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:52.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:53.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:53.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:53.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:53.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:53.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:53.845+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:54.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:54.053+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:54.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:54.817+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:54.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:54.853+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:55.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:55.029+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:55.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:55.837+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:55.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:55.845+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:55.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:55.985+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:56.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:56.821+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:56.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:56.873+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:56.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:56.993+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:57.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:57.825+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:57.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:57.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:58.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:58.025+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:58.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:58.861+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:58.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:58.893+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:31:59.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:31:59.073+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:59.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:31:59.869+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:31:59.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:31:59.921+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:00.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:00.057+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:00.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:00.901+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:00.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:00.917+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:01.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:01.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:01.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:01.877+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:01.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:01.885+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:02.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:02.061+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:02.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:02.853+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:02.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:02.905+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:03.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:03.109+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:03.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:03.881+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:03.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:03.905+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:04.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:04.145+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:04.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:04.869+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:04.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:04.897+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:05.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:05.125+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:05.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:05.893+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:05.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:05.925+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:06.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:06.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:06.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:06.917+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:06.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:06.929+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:07.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:07.153+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:07.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:07.909+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:07.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:07.961+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:08.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:08.133+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:08.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:08.881+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:08.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:08.941+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:09.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:09.101+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:09.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:09.885+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:09.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:09.941+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:10.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:10.105+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:10.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:10.917+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:10.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:10.933+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:11.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:11.105+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:11.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:11.949+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:11.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:11.977+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:12.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:12.085+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:12.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:12.993+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:13.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:13.009+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:13.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:13.081+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:14.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:14.041+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:14.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:14.049+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:14.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:14.065+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:15.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:15.045+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:15.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:15.057+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:15.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:15.081+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:16.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:16.001+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:16.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:16.085+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:16.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:16.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:17.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:17.009+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:17.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:17.093+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:17.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:17.101+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:18.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:18.013+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:18.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:18.061+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:18.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:18.153+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:18.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:18.981+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:19.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:19.033+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:19.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:19.185+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:20.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:20.001+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:20.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:20.041+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:20.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:20.185+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:20.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:20.965+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:21.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:21.017+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:21.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:21.228+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:21.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:21.936+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:22.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:22.060+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:22.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:22.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:22.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:22.956+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:23.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:23.072+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:23.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:23.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:23.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:23.916+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:24.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:24.080+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:24.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:24.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:24.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:24.944+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:25.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:25.056+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:25.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:25.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:25.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:25.932+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:26.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:26.016+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:26.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:26.136+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:26.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:26.928+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:27.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:27.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:27.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:27.160+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:27.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:27.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:28.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:28.048+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:28.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:28.172+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:28.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:28.920+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:29.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:29.012+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:29.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:29.180+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:29.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:29.912+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:30.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:30.032+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:30.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:30.192+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:30.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:30.868+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:31.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:31.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:31.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:31.216+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:31.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:31.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:32.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:32.024+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:32.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:32.248+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:32.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:32.844+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:33.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:33.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:33.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:33.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:33.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:33.828+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:33.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:33.976+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:34.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:34.292+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:34.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:34.844+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:35.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:35.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:35.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:35.292+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:35.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:35.800+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:36.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:36.008+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:36.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:36.288+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:36.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:36.804+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:37.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:37.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:37.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:37.312+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:37.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:37.820+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:38.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:38.028+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:38.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:38.352+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:38.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:38.848+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:39.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:39.000+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:39.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:39.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:39.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:39.812+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:40.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:40.004+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:40.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:40.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:40.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:40.824+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:41.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:41.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:41.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:41.384+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:41.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:41.864+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:42.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:42.048+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:42.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:42.376+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:42.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:42.848+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:43.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:43.060+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:43.363 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:43.360+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:43.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:43.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:44.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:44.036+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:44.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:44.372+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:44.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:44.856+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:45.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:45.020+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:45.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:45.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:45.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:45.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:45.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:45.988+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:46.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:46.432+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:46.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:46.880+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:46.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:46.968+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:47.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:47.388+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:47.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:47.876+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:47.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:47.952+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:48.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:48.360+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:48.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:48.912+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:48.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:48.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:49.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:49.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:49.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:49.892+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:49.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:49.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:50.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:50.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:50.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:50.920+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:50.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:50.972+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:51.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:51.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:51.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:51.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:51.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:51.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:52.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:52.308+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:52.903 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:52.900+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:52.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:52.952+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:53.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:53.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:53.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:53.916+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:53.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:53.940+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:54.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:54.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:54.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:54.920+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:54.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:54.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:55.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:55.280+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:55.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:55.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:55.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:55.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:56.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:56.308+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:56.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:56.844+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:56.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:56.944+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:57.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:57.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:57.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:57.804+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:57.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:57.952+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:58.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:58.376+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:58.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:58.812+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:58.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:58.924+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:32:59.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:32:59.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:59.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:32:59.820+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:32:59.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:32:59.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:00.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:00.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:00.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:00.776+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:00.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:00.916+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:01.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:01.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:01.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:01.752+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:01.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:01.936+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:02.325 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:02.320+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:02.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:02.780+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:02.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:02.904+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:03.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:03.368+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:03.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:03.768+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:03.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:03.868+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:04.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:04.392+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:04.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:04.728+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:04.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:04.840+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:05.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:05.380+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:05.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:05.712+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:05.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:05.824+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:06.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:06.360+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:06.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:06.724+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:06.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:06.820+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:07.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:07.356+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:07.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:07.692+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:07.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:07.864+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:08.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:08.368+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:08.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:08.712+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:08.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:08.896+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:09.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:09.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:09.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:09.675+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:09.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:09.907+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:10.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:10.351+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:10.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:10.727+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:10.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:10.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:11.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:11.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:11.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:11.703+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:11.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:11.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:12.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:12.371+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:12.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:12.671+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:12.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:12.895+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:13.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:13.327+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:13.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:13.711+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:13.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:13.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:14.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:14.367+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:14.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:14.667+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:14.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:14.843+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:15.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:15.331+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:15.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:15.651+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:15.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:15.879+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:16.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:16.351+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:16.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:16.655+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:16.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:16.903+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:17.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:17.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:17.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:17.703+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:17.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:17.891+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:18.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:18.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:18.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:18.659+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:18.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:18.887+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:19.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:19.299+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:19.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:19.679+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:19.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:19.879+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:20.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:20.299+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:20.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:20.643+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:20.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:20.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:21.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:21.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:21.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:21.623+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:21.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:21.851+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:22.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:22.339+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:22.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:22.583+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:22.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:22.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:23.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:23.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:23.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:23.547+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:23.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:23.855+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:24.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:24.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:24.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:24.567+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:24.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:24.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:25.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:25.359+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:25.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:25.555+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:25.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:25.859+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:26.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:26.383+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:26.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:26.587+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:26.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:26.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:27.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:27.335+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:27.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:27.543+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:27.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:27.791+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:28.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:28.375+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:28.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:28.579+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:28.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:28.771+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:29.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:29.347+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:29.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:29.531+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:29.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:29.791+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:30.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:30.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:30.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:30.531+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:30.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:30.807+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:31.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:31.355+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:31.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:31.507+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:31.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:31.819+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:32.325 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:32.319+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:32.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:32.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:32.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:32.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:33.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:33.279+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:33.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:33.479+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:33.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:33.863+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:34.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:34.327+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:34.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:34.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:34.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:34.827+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:35.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:35.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:35.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:35.503+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:35.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:35.847+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:36.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:36.307+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:36.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:36.519+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:36.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:36.799+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:37.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:37.303+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:37.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:37.487+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:37.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:37.831+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:38.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:38.259+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:38.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:38.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:38.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:38.807+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:39.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:39.291+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:39.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:39.459+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:39.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:39.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:40.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:40.311+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:40.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:40.435+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:40.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:40.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:41.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:41.343+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:41.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:41.387+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:41.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:41.811+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:42.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:42.363+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:42.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:42.407+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:42.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:42.803+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:43.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:43.407+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:43.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:43.423+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:43.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:43.823+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:44.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:44.367+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:44.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:44.415+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:44.790 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:44.787+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:45.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:45.399+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:45.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:45.467+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:45.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:45.755+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:46.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:46.391+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:46.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:46.511+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:46.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:46.743+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:47.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:47.351+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:47.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:47.551+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:47.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:47.735+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:48.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:48.315+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:48.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:48.535+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:48.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:48.771+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:49.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:49.279+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:49.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:49.539+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:49.764 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:49.759+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:50.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:50.267+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:50.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:50.539+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:50.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:50.739+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:51.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:51.251+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:51.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:51.499+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:51.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:51.783+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:52.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:52.255+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:52.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:52.507+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:52.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:52.751+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:53.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:53.251+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:53.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:53.507+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:53.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:53.719+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:54.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:54.219+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:54.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:54.551+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:54.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:54.727+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:55.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:55.179+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:55.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:55.587+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:55.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:55.687+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:56.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:56.203+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:56.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:56.547+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:56.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:56.663+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:57.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:57.235+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:57.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:57.591+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:57.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:57.695+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:58.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:58.278+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:58.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:58.554+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:58.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:58.738+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:33:59.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:33:59.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:59.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:33:59.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:33:59.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:33:59.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:00.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:00.342+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:00.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:00.598+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:00.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:00.762+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:01.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:01.310+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:01.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:01.574+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:01.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:01.750+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:02.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:02.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:02.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:02.618+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:02.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:02.702+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:03.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:03.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:03.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:03.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:03.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:03.654+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:04.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:04.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:04.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:04.586+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:04.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:04.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:05.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:05.394+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:05.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:05.546+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:05.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:05.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:06.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:06.366+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:06.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:06.542+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:06.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:06.642+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:07.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:07.394+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:07.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:07.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:07.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:07.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:08.371 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:08.366+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:08.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:08.554+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:08.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:08.586+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:09.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:09.378+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:09.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:09.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:09.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:09.570+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:10.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:10.330+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:10.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:10.542+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:10.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:10.554+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:11.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:11.346+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:11.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:11.566+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:11.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:11.578+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:12.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:12.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:12.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:12.550+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:12.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:12.562+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:13.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:13.346+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:13.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:13.530+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:13.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:13.590+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:14.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:14.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:14.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:14.570+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:14.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:14.586+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:15.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:15.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:15.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:15.554+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:15.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:15.598+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:16.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:16.358+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:16.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:16.514+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:16.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:16.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:17.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:17.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:17.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:17.518+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:17.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:17.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:18.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:18.350+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:18.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:18.554+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:18.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:18.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:19.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:19.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:19.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:19.570+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:19.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:19.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:20.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:20.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:20.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:20.566+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:20.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:20.622+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:21.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:21.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:21.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:21.586+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:21.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:21.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:22.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:22.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:22.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:22.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:22.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:22.618+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:23.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:23.326+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:23.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:23.578+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:23.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:23.590+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:24.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:24.354+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:24.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:24.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:24.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:24.622+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:25.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:25.318+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:25.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:25.582+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:25.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:25.638+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:26.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:26.314+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:26.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:26.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:26.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:26.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:27.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:27.362+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:27.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:27.610+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:27.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:27.694+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:28.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:28.406+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:28.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:28.634+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:28.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:28.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:29.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:29.378+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:29.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:29.646+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:29.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:29.666+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:30.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:30.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:30.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:30.658+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:30.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:30.658+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:31.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:31.458+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:31.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:31.670+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:31.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:31.690+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:32.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:32.438+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:32.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:32.630+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:32.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:32.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:33.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:33.426+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:33.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:33.614+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:33.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:33.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:34.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:34.382+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:34.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:34.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:34.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:34.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:35.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:35.370+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:35.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:35.566+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:35.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:35.622+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:36.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:36.374+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:36.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:36.582+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:36.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:36.606+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:37.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:37.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:37.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:37.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:37.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:37.638+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:38.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:38.398+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:38.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:38.602+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:38.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:38.606+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:39.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:39.402+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:39.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:39.562+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:39.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:39.614+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:40.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:40.406+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:40.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:40.562+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:40.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:40.626+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:41.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:41.390+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:41.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:41.566+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:41.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:41.630+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:42.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:42.438+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:42.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:42.522+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:42.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:42.646+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:43.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:43.414+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:43.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:43.530+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:43.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:43.626+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:44.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:44.434+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:44.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:44.506+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:44.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:44.594+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:45.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:45.402+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:45.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:45.510+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:45.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:45.610+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:46.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:46.418+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:46.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:46.526+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:46.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:46.578+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:47.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:47.417+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:47.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:47.541+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:47.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:47.593+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:48.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:48.373+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:48.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:48.553+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:48.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:48.593+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:49.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:49.349+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:49.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:49.565+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:49.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:49.577+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:50.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:50.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:50.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:50.553+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:50.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:50.561+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:51.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:51.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:51.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:51.537+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:51.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:51.545+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:52.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:52.437+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:52.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:52.513+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:52.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:52.581+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:53.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:53.397+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:53.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:53.545+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:53.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:53.565+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:54.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:54.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:54.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:54.557+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:54.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:54.573+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:55.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:55.377+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:55.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:55.545+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:55.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:55.601+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:56.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:56.385+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:56.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:56.561+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:56.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:56.641+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:57.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:57.365+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:57.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:57.525+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:57.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:57.601+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:58.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:58.329+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:58.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:58.477+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:58.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:58.649+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:59.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:34:59.373+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:34:59.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:34:59.525+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:34:59.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:34:59.625+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:00.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:00.333+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:00.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:00.489+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:00.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:00.609+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:01.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:01.301+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:01.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:01.521+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:01.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:01.573+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:02.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:02.345+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:02.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:02.533+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:02.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:02.569+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:03.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:03.345+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:03.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:03.537+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:03.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:03.573+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:04.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:04.361+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:04.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:04.569+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:04.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:04.601+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:05.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:05.397+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:05.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:05.585+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:05.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:05.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:06.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:06.441+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:06.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:06.629+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:06.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:06.633+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:07.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:07.477+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:07.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:07.625+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:07.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:07.653+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:08.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:08.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:08.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:08.613+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:08.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:08.669+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:09.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:09.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:09.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:09.633+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:09.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:09.653+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:10.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:10.413+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:10.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:10.677+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:10.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:10.681+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:11.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:11.413+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:11.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:11.677+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:11.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:11.701+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:12.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:12.393+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:12.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:12.629+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:12.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:12.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:13.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:13.401+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:13.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:13.681+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:13.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:13.701+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:14.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:14.449+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:14.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:14.661+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:14.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:14.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:15.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:15.425+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:15.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:15.677+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:15.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:15.693+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:16.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:16.453+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:16.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:16.661+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:16.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:16.661+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:17.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:17.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:17.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:17.625+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:17.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:17.677+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:18.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:18.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:18.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:18.649+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:18.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:18.673+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:19.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:19.441+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:19.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:19.641+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:19.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:19.681+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:20.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:20.421+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:20.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:20.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:20.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:20.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:21.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:21.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:21.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:21.637+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:21.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:21.657+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:22.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:22.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:22.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:22.629+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:22.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:22.705+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:23.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:23.413+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:23.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:23.625+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:23.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:23.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:24.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:24.461+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:24.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:24.621+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:24.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:24.637+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:25.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:25.465+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:25.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:25.665+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:25.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:25.673+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:26.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:26.457+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:26.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:26.657+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:26.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:26.673+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:27.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:27.469+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:27.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:27.653+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:27.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:27.725+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:28.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:28.433+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:28.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:28.669+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:28.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:28.717+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:29.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:29.469+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:29.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:29.665+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:29.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:29.761+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:30.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:30.445+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:30.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:30.673+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:30.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:30.737+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:31.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:31.397+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:31.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:31.661+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:31.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:31.753+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:32.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:32.357+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:32.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:32.661+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:32.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:32.733+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:33.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:33.321+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:33.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:33.685+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:33.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:33.717+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:34.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:34.289+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:34.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:34.693+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:34.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:34.757+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:35.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:35.269+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:35.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:35.649+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:35.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:35.765+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:36.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:36.276+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:36.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:36.608+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:36.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:36.804+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:37.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:37.288+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:37.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:37.612+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:37.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:37.820+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:38.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:38.320+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:38.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:38.600+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:38.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:38.828+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:39.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:39.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:39.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:39.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:39.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:39.840+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:40.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:40.320+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:40.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:40.620+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:40.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:40.796+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:41.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:41.276+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:41.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:41.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:41.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:41.800+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:42.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:42.236+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:42.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:42.528+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:42.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:42.804+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:43.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:43.188+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:43.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:43.516+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:43.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:43.772+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:44.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:44.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:44.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:44.560+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:44.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:44.740+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:45.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:45.156+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:45.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:45.540+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:45.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:45.756+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:46.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:46.200+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:46.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:46.580+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:46.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:46.740+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:47.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:47.184+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:47.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:47.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:47.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:47.780+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:48.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:48.224+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:48.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:48.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:48.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:48.796+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:49.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:49.192+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:49.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:49.632+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:49.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:49.836+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:50.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:50.232+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:50.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:50.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:50.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:50.812+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:51.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:51.272+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:51.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:51.616+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:51.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:51.800+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:52.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:52.292+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:52.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:52.608+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:52.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:52.832+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:53.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:53.304+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:53.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:53.596+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:53.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:53.792+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:54.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:54.332+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:54.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:54.624+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:54.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:54.768+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:55.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:55.384+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:55.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:55.608+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:55.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:55.756+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:56.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:56.400+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:56.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:56.612+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:56.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:56.732+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:57.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:57.356+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:57.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:57.588+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:57.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:57.772+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:58.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:58.324+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:58.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:58.604+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:58.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:58.760+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:59.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:35:59.280+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:35:59.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:35:59.620+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:35:59.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:35:59.808+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:00.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:00.328+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:00.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:00.632+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:00.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:00.848+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:01.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:01.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:01.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:01.616+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:01.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:01.876+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:02.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:02.316+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:02.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:02.616+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:02.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:02.860+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:03.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:03.364+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:03.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:03.628+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:03.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:03.888+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:04.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:04.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:04.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:04.668+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:04.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:04.852+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:05.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:05.348+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:05.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:05.652+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:05.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:05.884+0000 7f0a1b620700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:06.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:06.300+0000 7f71e2234700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:06.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:06.672+0000 7f040a32f700 -1 osd.2 155 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:06.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:06.856+0000 7f0a1b620700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:07.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:07.316+0000 7f71e2234700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:07.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:07.648+0000 7f040a32f700 -1 osd.2 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:07.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:07.896+0000 7f0a1b620700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:08.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:08.344+0000 7f71e2234700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:08.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:08.664+0000 7f040a32f700 -1 osd.2 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:08.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:08.904+0000 7f0a1b620700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:09.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:09.324+0000 7f71e2234700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:09.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:09.628+0000 7f040a32f700 -1 osd.2 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:09.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:09.876+0000 7f0a1b620700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:10.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:10.300+0000 7f71e2234700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:10.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:10.584+0000 7f040a32f700 -1 osd.2 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:10.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:10.864+0000 7f0a1b620700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:11.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:11.268+0000 7f71e2234700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:11.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:11.588+0000 7f040a32f700 -1 osd.2 156 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:11.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:11.836+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:12.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:12.308+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:12.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:12.608+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:12.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:12.880+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:13.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:13.260+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:13.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:13.572+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:13.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:13.844+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:14.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:14.268+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:14.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:14.532+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:14.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:14.880+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:15.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:15.244+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:15.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:15.556+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:15.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:15.880+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:16.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:16.268+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:16.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:16.600+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:16.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:16.880+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:17.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:17.228+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:17.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:17.616+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:17.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:17.896+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:18.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:18.240+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:18.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:18.620+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:18.884 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:18.880+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:19.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:19.292+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:19.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:19.648+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:19.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:19.888+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:20.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:20.268+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:20.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:20.616+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:20.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:20.848+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:21.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:21.304+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:21.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:21.584+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:21.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:21.816+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:22.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:22.272+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:22.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:22.604+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:22.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:22.776+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:23.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:23.268+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:23.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:23.588+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:23.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:23.772+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:24.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:24.248+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:24.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:24.619+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:24.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:24.775+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:25.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:25.275+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:25.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:25.635+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:25.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:25.763+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:26.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:26.311+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:26.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:26.587+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:26.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:26.743+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:27.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:27.275+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:27.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:27.595+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:27.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:27.731+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:28.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:28.275+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:28.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:28.623+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:28.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:28.735+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:29.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:29.323+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:29.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:29.647+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:29.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:29.767+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:30.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:30.363+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:30.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:30.607+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:30.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:30.719+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:31.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:31.375+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:31.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:31.623+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:31.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:31.699+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:32.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:32.367+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:32.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:32.615+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:32.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:32.679+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:33.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:33.335+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:33.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:33.591+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:33.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:33.711+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:34.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:34.387+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:34.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:34.567+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:34.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:34.715+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:35.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:35.419+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:35.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:35.607+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:35.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:35.755+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:36.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:36.375+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:36.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:36.599+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:36.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:36.763+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:37.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:37.331+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:37.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:37.591+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:37.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:37.735+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:38.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:38.299+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:38.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:38.591+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:38.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:38.775+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:39.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:39.347+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:39.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:39.599+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:39.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:39.787+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:40.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:40.387+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:40.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:40.599+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:40.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:40.819+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:41.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:41.347+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:41.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:41.579+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:41.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:41.783+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:42.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:42.327+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:42.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:42.555+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:42.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:42.775+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:43.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:43.367+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:43.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:43.567+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:43.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:43.819+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:44.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:44.399+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:44.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:44.595+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:44.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:44.819+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:45.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:45.387+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:45.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:45.547+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:45.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:45.863+0000 7f0a1b620700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:46.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:46.399+0000 7f71e2234700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:46.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:46.499+0000 7f040a32f700 -1 osd.2 157 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:46.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:46.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:47.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:47.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:47.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:47.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:47.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:47.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:48.363 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:48.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:48.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:48.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:48.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:48.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:49.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:49.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:49.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:49.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:49.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:49.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:50.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:50.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:50.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:50.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:50.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:50.955+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:51.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:51.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:51.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:51.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:51.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:51.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:52.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:52.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:52.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:52.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:52.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:52.939+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:53.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:53.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:53.485 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:53.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:53.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:53.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:54.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:54.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:54.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:54.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:55.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:55.003+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:55.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:55.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:55.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:55.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:55.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:55.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:56.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:56.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:56.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:56.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:57.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:57.019+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:57.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:57.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:57.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:57.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:58.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:58.035+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:58.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:58.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:58.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:58.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:36:59.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:36:59.063+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:59.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:36:59.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:36:59.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:36:59.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:00.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:00.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:00.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:00.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:00.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:00.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:01.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:01.079+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:01.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:01.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:01.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:01.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:02.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:02.063+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:02.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:02.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:02.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:02.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:03.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:03.059+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:03.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:03.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:03.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:03.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:04.033 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:04.027+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:04.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:04.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:04.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:04.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:05.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:05.075+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:05.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:05.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:05.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:05.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:06.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:06.087+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:06.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:06.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:06.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:06.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:07.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:07.051+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:07.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:07.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:07.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:07.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:08.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:08.027+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:08.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:08.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:08.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:08.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:09.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:09.011+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:09.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:09.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:09.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:09.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:10.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:09.999+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:10.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:10.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:10.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:10.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:11.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:11.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:11.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:11.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:11.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:11.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:11.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:11.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:12.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:12.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:12.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:12.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:13.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:13.022+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:13.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:13.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:13.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:13.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:14.066 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:14.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:14.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:14.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:14.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:14.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:15.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:15.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:15.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:15.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:15.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:15.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:15.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:15.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:16.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:16.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:16.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:16.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:17.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:16.998+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:17.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:17.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:17.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:17.314+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:17.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:17.986+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:18.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:18.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:18.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:18.286+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:18.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:18.990+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:19.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:19.274+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:19.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:19.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:19.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:19.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:20.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:20.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:20.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:20.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:20.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:20.986+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:21.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:21.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:21.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:21.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:21.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:21.982+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:22.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:22.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:22.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:22.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:23.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:23.010+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:23.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:23.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:23.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:23.362+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:24.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:24.050+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:24.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:24.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:24.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:24.382+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:25.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:25.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:25.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:25.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:25.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:25.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:26.075 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:26.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:26.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:26.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:26.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:26.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:27.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:27.106+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:27.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:27.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:27.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:27.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:28.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:28.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:28.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:28.106+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:28.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:28.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:29.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:29.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:29.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:29.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:29.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:29.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:30.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:30.034+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:30.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:30.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:30.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:30.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:31.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:31.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:31.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:31.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:31.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:31.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:32.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:32.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:32.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:32.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:32.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:32.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:33.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:33.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:33.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:33.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:33.427 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:33.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:34.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:34.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:34.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:34.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:34.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:34.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:35.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:35.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:35.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:35.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:35.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:35.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:36.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:36.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:36.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:36.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:36.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:36.378+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:37.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:37.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:37.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:37.178+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:37.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:37.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:38.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:38.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:38.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:38.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:38.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:38.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:39.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:39.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:39.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:39.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:39.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:39.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:40.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:40.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:40.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:40.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:40.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:40.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:41.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:41.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:41.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:41.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:41.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:41.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:42.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:42.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:42.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:42.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:42.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:42.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:43.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:43.034+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:43.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:43.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:43.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:43.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:44.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:44.042+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:44.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:44.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:44.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:44.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:45.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:45.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:45.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:45.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:45.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:45.354+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:46.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:46.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:46.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:46.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:46.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:46.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:47.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:47.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:47.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:47.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:47.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:47.350+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:48.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:48.090+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:48.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:48.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:48.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:48.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:49.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:49.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:49.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:49.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:49.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:49.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:50.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:50.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:50.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:50.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:50.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:50.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:51.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:51.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:51.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:51.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:51.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:51.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:52.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:52.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:52.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:52.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:52.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:52.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:53.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:53.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:53.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:53.150+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:53.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:53.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:54.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:54.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:54.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:54.134+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:54.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:54.314+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:55.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:55.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:55.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:55.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:55.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:55.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:56.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:56.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:56.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:56.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:56.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:56.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:57.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:57.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:57.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:57.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:57.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:57.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:58.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:58.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:58.210 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:58.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:58.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:58.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:37:59.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:37:59.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:59.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:37:59.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:37:59.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:37:59.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:00.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:00.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:00.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:00.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:00.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:00.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:01.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:01.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:01.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:01.145+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:01.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:01.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:02.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:02.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:02.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:02.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:02.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:02.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:03.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:03.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:03.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:03.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:03.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:03.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:04.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:04.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:04.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:04.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:04.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:04.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:05.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:05.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:05.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:05.161+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:05.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:05.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:06.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:06.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:06.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:06.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:06.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:06.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:07.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:07.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:07.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:07.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:07.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:07.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:08.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:08.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:08.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:08.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:08.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:08.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:09.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:09.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:09.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:09.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:09.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:09.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:10.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:10.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:10.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:10.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:10.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:10.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:11.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:11.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:11.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:11.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:11.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:11.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:12.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:12.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:12.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:12.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:12.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:12.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:13.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:13.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:13.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:13.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:13.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:13.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:14.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:14.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:14.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:14.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:14.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:14.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:15.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:15.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:15.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:15.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:15.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:15.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:16.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:16.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:16.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:16.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:16.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:16.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:17.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:17.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:17.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:17.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:17.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:17.193+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:18.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:18.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:18.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:18.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:18.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:18.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:19.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:19.133+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:19.186 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:19.185+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:19.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:19.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:20.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:20.105+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:20.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:20.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:20.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:20.249+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:21.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:21.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:21.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:21.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:21.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:21.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:22.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:22.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:22.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:22.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:22.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:22.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:23.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:23.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:23.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:23.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:23.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:23.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:24.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:24.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:24.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:24.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:24.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:24.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:25.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:25.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:25.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:25.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:25.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:25.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:26.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:26.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:26.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:26.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:26.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:26.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:27.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:27.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:27.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:27.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:27.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:27.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:28.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:28.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:28.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:28.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:28.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:28.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:29.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:29.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:29.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:29.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:29.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:29.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:30.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:30.109+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:30.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:30.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:30.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:30.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:31.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:31.149+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:31.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:31.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:31.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:31.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:32.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:32.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:32.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:32.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:32.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:32.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:33.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:33.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:33.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:33.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:33.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:33.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:34.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:34.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:34.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:34.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:34.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:34.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:35.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:35.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:35.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:35.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:35.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:35.333+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:36.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:36.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:36.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:36.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:36.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:36.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:37.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:37.149+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:37.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:37.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:37.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:37.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:38.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:38.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:38.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:38.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:38.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:38.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:39.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:39.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:39.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:39.141+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:39.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:39.293+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:40.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:40.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:40.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:40.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:40.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:40.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:41.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:41.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:41.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:41.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:41.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:41.249+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:42.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:42.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:42.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:42.109+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:42.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:42.261+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:43.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:43.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:43.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:43.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:43.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:43.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:44.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:44.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:44.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:44.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:44.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:44.293+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:45.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:45.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:45.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:45.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:45.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:45.285+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:46.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:46.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:46.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:46.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:46.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:46.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:47.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:47.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:47.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:47.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:47.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:47.369+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:48.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:48.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:48.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:48.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:48.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:48.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:49.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:49.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:49.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:49.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:49.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:49.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:50.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:50.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:50.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:50.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:50.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:50.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:51.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:51.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:51.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:51.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:51.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:51.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:52.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:52.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:52.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:52.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:52.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:52.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:53.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:53.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:53.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:53.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:53.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:53.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:54.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:54.096+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:54.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:54.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:54.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:54.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:55.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:55.056+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:55.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:55.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:55.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:55.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:56.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:56.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:56.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:56.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:56.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:56.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:56.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:56.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:57.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:57.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:57.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:57.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:58.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:58.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:58.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:58.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:58.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:58.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:59.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:38:59.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:38:59.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:38:59.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:38:59.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:38:59.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:00.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:00.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:00.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:00.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:00.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:00.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:01.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:01.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:01.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:01.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:01.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:01.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:02.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:02.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:02.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:02.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:02.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:02.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:02.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:02.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:03.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:03.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:03.488 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:03.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:03.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:03.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:04.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:04.148+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:04.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:04.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:04.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:04.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:05.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:05.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:05.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:05.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:06.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:06.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:06.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:06.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:06.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:06.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:07.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:07.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:07.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:07.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:07.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:07.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:08.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:08.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:08.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:08.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:08.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:08.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:08.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:08.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:09.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:09.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:09.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:09.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:09.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:09.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:10.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:10.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:10.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:10.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:10.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:10.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:11.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:11.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:11.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:11.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:11.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:11.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:12.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:12.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:12.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:12.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:12.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:12.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:13.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:13.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:13.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:13.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:13.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:13.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:14.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:14.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:14.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:14.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:14.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:14.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:15.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:15.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:15.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:15.540+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:15.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:15.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:16.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:16.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:16.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:16.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:16.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:16.908+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:17.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:17.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:17.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:17.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:17.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:17.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:18.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:18.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:18.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:18.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:18.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:18.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:19.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:19.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:19.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:19.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:19.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:19.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:19.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:19.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:20.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:20.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:20.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:20.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:20.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:20.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:21.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:21.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:21.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:21.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:21.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:21.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:22.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:22.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:22.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:22.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:22.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:22.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:23.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:23.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:23.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:23.808+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:23.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:23.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:24.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:24.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:24.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:24.808+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:24.896 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:24.892+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:25.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:25.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:25.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:25.788+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:25.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:25.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:26.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:26.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:26.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:26.772+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:26.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:26.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:27.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:27.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:27.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:27.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:27.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:27.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:28.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:28.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:28.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:28.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:28.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:28.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:29.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:29.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:29.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:29.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:29.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:29.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:30.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:30.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:30.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:30.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:30.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:30.836+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:31.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:31.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:31.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:31.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:31.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:31.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:32.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:32.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:32.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:32.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:32.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:32.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:33.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:33.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:33.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:33.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:33.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:33.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:34.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:34.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:34.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:34.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:34.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:34.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:35.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:35.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:35.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:35.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:35.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:35.907+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:36.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:36.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:36.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:36.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:36.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:36.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:37.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:37.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:37.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:37.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:37.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:37.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:38.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:38.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:38.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:38.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:38.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:38.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:39.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:39.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:39.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:39.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:39.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:39.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:40.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:40.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:40.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:40.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:40.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:40.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:41.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:41.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:41.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:41.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:41.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:41.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:42.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:42.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:42.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:42.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:42.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:42.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:43.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:43.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:43.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:43.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:43.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:43.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:44.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:44.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:44.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:44.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:45.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:45.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:45.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:45.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:45.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:45.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:45.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:45.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:46.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:46.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:46.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:46.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:46.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:46.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:47.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:47.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:47.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:47.871+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:47.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:47.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:48.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:48.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:48.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:48.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:48.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:48.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:49.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:49.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:49.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:49.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:49.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:49.967+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:50.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:50.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:50.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:50.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:50.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:50.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:51.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:51.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:51.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:51.959+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:51.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:51.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:52.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:52.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:52.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:52.911+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:52.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:52.923+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:53.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:53.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:53.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:53.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:53.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:53.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:54.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:54.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:54.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:54.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:54.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:54.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:55.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:55.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:55.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:55.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:55.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:55.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:56.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:56.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:56.890 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:56.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:56.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:56.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:57.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:57.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:57.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:57.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:57.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:57.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:58.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:58.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:58.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:58.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:58.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:58.991+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:39:59.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:39:59.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:59.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:39:59.851+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:39:59.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:39:59.991+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:00.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:00.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:00.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:00.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:00.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:00.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:01.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:01.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:01.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:01.867+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:01.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:01.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:02.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:02.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:02.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:02.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:02.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:02.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:03.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:03.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:03.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:03.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:03.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:03.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:04.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:04.247+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:04.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:04.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:04.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:04.967+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:05.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:05.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:05.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:05.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:06.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:06.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:06.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:06.239+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:06.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:06.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:06.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:06.963+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:07.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:07.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:07.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:07.807+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:07.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:07.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:08.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:08.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:08.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:08.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:08.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:08.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:09.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:09.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:09.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:09.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:09.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:09.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:10.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:10.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:10.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:10.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:10.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:10.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:11.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:11.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:11.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:11.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:11.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:11.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:12.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:12.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:12.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:12.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:12.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:12.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:13.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:13.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:13.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:13.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:13.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:13.895+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:14.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:14.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:14.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:14.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:14.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:14.927+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:15.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:15.239+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:15.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:15.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:15.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:15.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:16.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:16.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:16.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:16.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:16.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:16.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:17.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:17.235+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:17.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:17.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:18.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:17.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:18.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:18.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:18.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:18.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:19.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:19.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:19.209 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:19.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:19.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:19.871+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:20.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:19.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:20.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:20.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:20.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:20.891+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:20.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:20.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:21.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:21.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:21.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:21.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:22.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:22.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:22.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:22.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:22.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:22.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:22.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:22.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:23.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:23.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:23.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:23.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:23.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:23.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:24.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:24.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:24.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:24.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:24.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:24.970+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:25.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:25.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:25.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:25.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:25.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:25.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:26.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:26.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:26.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:26.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:26.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:26.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:27.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:27.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:27.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:27.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:27.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:27.918+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:28.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:28.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:28.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:28.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:28.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:28.958+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:29.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:29.290+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:29.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:29.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:29.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:29.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:30.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:30.298+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:30.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:30.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:30.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:30.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:31.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:31.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:31.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:31.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:32.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:32.006+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:32.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:32.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:32.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:32.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:33.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:33.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:33.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:33.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:33.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:33.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:34.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:34.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:34.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:34.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:34.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:34.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:35.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:35.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:35.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:35.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:35.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:35.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:36.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:36.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:36.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:36.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:36.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:36.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:37.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:37.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:37.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:37.286+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:37.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:37.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:38.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:38.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:38.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:38.298+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:38.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:38.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:39.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:39.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:39.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:39.338+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:39.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:39.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:40.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:40.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:40.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:40.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:40.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:40.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:41.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:41.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:41.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:41.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:41.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:41.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:42.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:42.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:42.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:42.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:42.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:42.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:43.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:43.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:43.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:43.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:43.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:43.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:44.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:44.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:44.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:44.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:44.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:44.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:45.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:45.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:45.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:45.282+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:45.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:45.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:46.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:46.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:46.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:46.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:46.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:46.718+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:47.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:47.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:47.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:47.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:47.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:47.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:48.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:48.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:48.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:48.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:48.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:48.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:49.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:49.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:49.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:49.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:49.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:49.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:50.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:50.118+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:50.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:50.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:50.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:50.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:51.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:51.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:51.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:51.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:51.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:51.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:52.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:52.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:52.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:52.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:52.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:52.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:53.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:53.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:53.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:53.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:53.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:53.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:54.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:54.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:54.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:54.214+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:54.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:54.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:55.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:55.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:55.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:55.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:55.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:55.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:56.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:56.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:56.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:56.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:56.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:56.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:57.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:57.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:57.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:57.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:57.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:57.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:58.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:58.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:58.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:58.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:58.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:58.606+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:59.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:40:59.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:40:59.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:40:59.186+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:40:59.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:40:59.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:00.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:00.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:00.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:00.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:00.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:00.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:01.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:01.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:01.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:01.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:01.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:01.690+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:02.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:02.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:02.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:02.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:02.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:02.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:03.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:03.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:03.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:03.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:03.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:03.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:04.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:04.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:04.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:04.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:04.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:04.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:05.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:05.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:05.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:05.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:05.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:05.650+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:06.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:06.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:06.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:06.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:06.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:06.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:07.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:07.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:07.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:07.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:07.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:07.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:08.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:08.010+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:08.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:08.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:08.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:08.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:08.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:08.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:09.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:09.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:09.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:09.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:09.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:09.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:10.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:10.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:10.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:10.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:10.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:10.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:11.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:11.137+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:11.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:11.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:11.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:11.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:12.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:12.157+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:12.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:12.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:12.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:12.945+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:13.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:13.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:13.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:13.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:13.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:13.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:14.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:14.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:14.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:14.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:15.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:15.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:15.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:15.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:15.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:15.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:15.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:15.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:16.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:16.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:16.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:16.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:16.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:16.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:17.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:17.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:17.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:17.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:17.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:17.929+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:18.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:18.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:18.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:18.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:18.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:18.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:19.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:19.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:19.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:19.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:20.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:20.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:20.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:20.137+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:20.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:20.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:20.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:20.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:21.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:21.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:21.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:21.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:21.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:21.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:22.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:22.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:22.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:22.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:22.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:22.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:23.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:23.081+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:23.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:23.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:23.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:23.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:24.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:24.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:24.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:24.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:24.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:24.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:25.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:25.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:25.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:25.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:25.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:25.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:26.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:26.081+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:26.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:26.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:26.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:26.909+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:27.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:27.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:27.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:27.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:27.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:27.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:28.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:28.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:28.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:28.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:28.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:28.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:29.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:29.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:29.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:29.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:29.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:29.873+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:30.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:30.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:30.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:30.829+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:30.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:30.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:31.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:31.017+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:31.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:31.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:31.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:31.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:32.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:32.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:32.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:32.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:32.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:32.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:32.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:32.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:33.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:33.813+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:33.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:33.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:34.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:34.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:34.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:34.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:34.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:34.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:35.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:35.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:35.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:35.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:35.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:35.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:36.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:36.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:36.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:36.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:36.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:36.929+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:37.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:37.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:37.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:37.857+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:37.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:37.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:38.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:38.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:38.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:38.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:38.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:38.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:38.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:38.997+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:39.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:39.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:39.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:39.933+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:40.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:40.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:40.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:40.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:40.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:40.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:41.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:41.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:41.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:41.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:41.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:41.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:42.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:42.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:42.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:42.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:42.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:42.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:43.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:43.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:43.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:43.809+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:43.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:43.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:44.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:44.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:44.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:44.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:44.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:44.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:45.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:45.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:45.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:45.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:45.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:45.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:46.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:46.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:46.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:46.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:47.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:47.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:47.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:47.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:47.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:47.889+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:48.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:48.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:48.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:48.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:48.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:48.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:48.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:48.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:49.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:49.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:49.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:49.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:50.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:50.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:50.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:50.081+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:50.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:50.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:50.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:50.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:51.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:51.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:51.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:51.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:51.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:51.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:52.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:52.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:52.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:52.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:53.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:52.997+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:53.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:52.997+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:53.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:53.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:54.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:54.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:54.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:54.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:54.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:54.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:55.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:55.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:55.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:55.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:55.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:55.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:56.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:56.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:56.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:56.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:56.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:56.865+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:57.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:57.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:57.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:57.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:57.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:57.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:58.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:57.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:58.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:58.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:58.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:58.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:58.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:58.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:59.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:41:59.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:41:59.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:41:59.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:41:59.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:41:59.976+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:00.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:00.052+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:00.904 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:00.900+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:01.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:01.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:01.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:01.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:01.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:01.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:02.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:02.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:02.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:02.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:02.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:02.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:03.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:03.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:03.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:03.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:03.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:03.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:03.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:03.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:04.110 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:04.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:04.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:04.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:04.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:04.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:05.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:05.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:05.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:05.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:05.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:05.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:06.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:06.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:06.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:06.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:06.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:06.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:07.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:07.168+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:07.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:07.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:07.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:07.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:08.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:08.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:08.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:08.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:08.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:08.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:09.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:09.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:09.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:09.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:10.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:10.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:10.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:10.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:10.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:10.772+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:11.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:10.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:11.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:11.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:11.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:11.772+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:12.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:12.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:12.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:12.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:12.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:12.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:12.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:12.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:13.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:13.280+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:13.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:13.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:14.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:14.044+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:14.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:14.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:14.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:14.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:15.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:15.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:15.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:15.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:15.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:15.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:16.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:15.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:16.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:16.340+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:16.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:16.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:16.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:16.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:17.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:17.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:17.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:17.812+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:17.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:17.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:18.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:18.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:18.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:18.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:18.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:18.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:19.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:19.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:19.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:19.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:19.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:19.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:20.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:20.280+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:20.860 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:20.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:20.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:20.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:21.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:21.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:21.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:21.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:21.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:21.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:22.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:22.328+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:22.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:22.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:22.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:22.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:23.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:23.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:23.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:23.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:23.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:23.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:24.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:24.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:24.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:24.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:25.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:25.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:25.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:25.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:25.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:25.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:25.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:25.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:26.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:26.280+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:26.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:26.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:26.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:26.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:27.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:27.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:27.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:27.868+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:27.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:27.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:28.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:28.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:28.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:28.868+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:28.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:28.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:29.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:29.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:29.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:29.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:29.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:29.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:30.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:30.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:30.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:30.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:30.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:30.916+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:31.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:31.328+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:31.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:31.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:31.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:31.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:32.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:32.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:32.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:32.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:32.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:32.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:33.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:33.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:33.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:33.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:33.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:33.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:34.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:34.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:34.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:34.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:34.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:34.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:35.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:35.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:35.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:35.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:35.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:35.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:36.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:36.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:36.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:36.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:36.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:36.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:37.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:37.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:37.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:37.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:38.020 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:38.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:38.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:38.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:38.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:38.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:38.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:38.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:39.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:39.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:39.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:39.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:40.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:40.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:40.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:40.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:40.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:40.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:41.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:41.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:41.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:41.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:42.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:42.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:42.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:42.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:42.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:42.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:42.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:42.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:43.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:43.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:43.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:43.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:43.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:43.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:43.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:43.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:44.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:44.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:45.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:45.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:45.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:45.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:45.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:45.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:45.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:45.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:46.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:46.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:46.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:46.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:46.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:46.967+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:46.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:46.979+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:47.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:47.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:47.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:47.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:47.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:47.959+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:48.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:48.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:48.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:48.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:48.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:48.963+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:49.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:49.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:49.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:49.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:49.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:49.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:50.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:50.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:50.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:50.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:50.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:50.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:51.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:51.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:51.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:51.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:52.015 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:52.011+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:52.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:52.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:52.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:52.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:53.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:53.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:53.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:53.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:53.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:53.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:54.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:54.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:54.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:54.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:54.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:54.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:55.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:55.059+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:55.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:55.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:55.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:55.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:56.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:56.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:56.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:56.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:56.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:56.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:57.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:57.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:57.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:57.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:57.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:57.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:58.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:58.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:58.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:58.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:58.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:58.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:42:59.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:42:59.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:59.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:42:59.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:42:59.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:42:59.835+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:00.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:00.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:00.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:00.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:00.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:00.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:01.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:01.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:01.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:01.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:01.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:01.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:02.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:02.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:02.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:02.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:02.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:02.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:03.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:03.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:03.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:03.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:03.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:03.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:04.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:04.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:04.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:04.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:04.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:04.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:05.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:05.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:05.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:05.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:05.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:05.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:06.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:06.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:06.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:06.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:06.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:06.839+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:07.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:07.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:07.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:07.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:07.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:07.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:08.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:08.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:08.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:08.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:08.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:08.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:09.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:09.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:09.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:09.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:09.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:09.835+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:10.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:10.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:10.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:10.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:10.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:10.839+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:11.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:11.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:11.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:11.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:11.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:11.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:12.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:12.059+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:12.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:12.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:12.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:12.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:13.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:13.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:13.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:13.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:13.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:13.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:14.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:14.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:14.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:14.403+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:14.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:14.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:15.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:15.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:15.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:15.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:15.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:15.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:16.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:16.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:16.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:16.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:16.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:16.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:17.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:17.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:17.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:17.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:17.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:17.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:18.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:18.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:18.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:18.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:18.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:18.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:19.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:19.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:19.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:19.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:20.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:20.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:20.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:20.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:20.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:20.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:21.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:21.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:21.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:21.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:21.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:21.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:21.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:21.991+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:22.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:22.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:22.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:22.311+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:23.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:23.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:23.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:23.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:23.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:23.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:24.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:24.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:24.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:24.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:24.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:24.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:24.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:24.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:25.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:25.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:25.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:25.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:26.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:26.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:26.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:26.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:26.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:26.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:27.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:27.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:27.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:27.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:27.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:27.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:28.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:28.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:28.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:28.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:28.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:28.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:29.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:29.011+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:29.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:29.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:29.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:29.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:30.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:30.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:30.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:30.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:30.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:30.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:31.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:31.055+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:31.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:31.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:31.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:31.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:32.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:32.090+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:32.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:32.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:32.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:32.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:33.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:33.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:33.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:33.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:33.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:33.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:34.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:34.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:34.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:34.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:34.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:34.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:35.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:35.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:35.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:35.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:35.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:35.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:36.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:36.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:36.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:36.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:36.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:36.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:37.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:37.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:37.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:37.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:37.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:37.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:38.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:38.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:38.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:38.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:38.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:38.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:39.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:39.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:39.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:39.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:39.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:39.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:40.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:40.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:40.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:40.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:40.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:40.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:41.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:41.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:41.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:41.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:41.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:41.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:42.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:42.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:42.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:42.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:42.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:42.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:43.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:43.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:43.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:43.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:43.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:43.366+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:44.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:44.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:44.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:44.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:44.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:44.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:45.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:45.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:45.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:45.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:45.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:45.330+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:46.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:46.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:46.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:46.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:46.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:46.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:47.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:47.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:47.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:47.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:47.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:47.350+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:48.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:48.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:48.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:48.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:48.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:48.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:49.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:49.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:49.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:49.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:49.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:49.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:50.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:50.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:50.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:50.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:50.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:50.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:51.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:51.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:51.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:51.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:51.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:51.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:52.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:52.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:52.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:52.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:52.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:52.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:53.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:53.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:53.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:53.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:53.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:53.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:54.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:54.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:54.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:54.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:54.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:54.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:55.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:55.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:55.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:55.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:55.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:55.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:56.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:56.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:56.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:56.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:56.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:56.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:57.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:57.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:57.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:57.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:57.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:57.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:58.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:58.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:58.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:58.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:58.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:58.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:59.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:43:59.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:43:59.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:43:59.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:43:59.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:43:59.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:00.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:00.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:00.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:00.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:00.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:00.470+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:01.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:01.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:01.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:01.274+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:01.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:01.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:02.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:02.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:02.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:02.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:02.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:02.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:03.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:03.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:03.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:03.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:03.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:03.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:04.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:04.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:04.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:04.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:04.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:04.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:05.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:05.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:05.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:05.314+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:05.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:05.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:06.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:06.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:06.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:06.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:06.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:06.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:07.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:07.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:07.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:07.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:07.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:07.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:08.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:08.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:08.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:08.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:08.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:08.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:09.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:09.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:09.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:09.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:09.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:09.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:10.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:10.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:10.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:10.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:10.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:10.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:11.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:11.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:11.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:11.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:11.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:11.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:12.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:12.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:12.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:12.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:12.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:12.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:13.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:13.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:13.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:13.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:13.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:13.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:14.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:14.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:14.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:14.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:14.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:14.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:15.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:15.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:15.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:15.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:15.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:15.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:16.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:16.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:16.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:16.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:16.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:16.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:17.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:17.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:17.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:17.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:17.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:17.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:18.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:18.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:18.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:18.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:18.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:18.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:19.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:19.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:19.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:19.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:19.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:19.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:20.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:20.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:20.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:20.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:20.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:20.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:21.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:21.141+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:21.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:21.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:21.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:21.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:22.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:22.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:22.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:22.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:22.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:22.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:23.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:23.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:23.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:23.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:23.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:23.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:24.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:24.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:24.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:24.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:24.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:24.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:25.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:25.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:25.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:25.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:25.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:25.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:26.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:26.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:26.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:26.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:26.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:26.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:27.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:27.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:27.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:27.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:27.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:27.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:28.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:28.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:28.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:28.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:28.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:28.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:29.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:29.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:29.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:29.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:29.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:29.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:30.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:30.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:30.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:30.081+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:30.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:30.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:31.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:31.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:31.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:31.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:31.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:31.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:32.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:32.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:32.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:32.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:32.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:32.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:33.005 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:33.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:33.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:33.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:33.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:33.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:34.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:34.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:34.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:34.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:34.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:34.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:35.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:35.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:35.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:35.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:35.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:35.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:36.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:36.061+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:36.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:36.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:36.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:36.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:37.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:37.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:37.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:37.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:37.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:37.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:38.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:38.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:38.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:38.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:38.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:38.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:38.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:38.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:39.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:39.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:39.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:39.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:39.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:39.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:40.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:40.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:40.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:40.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:40.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:40.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:41.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:41.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:41.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:41.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:41.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:41.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:41.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:41.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:42.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:42.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:42.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:42.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:42.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:42.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:43.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:43.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:43.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:43.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:43.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:43.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:44.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:44.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:44.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:44.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:44.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:44.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:45.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:45.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:45.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:45.945+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:46.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:46.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:46.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:46.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:46.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:46.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:46.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:46.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:47.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:47.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:47.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:47.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:48.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:48.033+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:48.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:48.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:48.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:48.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:49.011 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:49.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:49.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:49.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:49.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:49.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:49.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:49.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:50.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:50.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:50.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:50.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:51.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:51.017+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:51.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:51.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:51.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:51.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:51.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:51.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:52.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:52.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:53.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:53.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:53.011 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:53.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:53.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:53.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:53.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:53.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:54.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:54.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:54.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:54.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:54.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:54.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:55.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:55.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:55.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:55.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:55.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:55.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:56.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:56.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:56.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:56.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:56.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:56.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:57.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:57.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:57.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:57.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:57.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:57.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:58.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:58.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:58.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:58.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:58.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:58.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:44:59.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:44:59.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:59.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:44:59.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:44:59.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:44:59.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:00.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:00.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:00.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:00.481+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:00.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:00.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:01.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:01.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:01.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:01.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:01.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:01.921+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:02.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:02.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:02.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:02.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:02.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:02.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:03.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:03.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:03.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:03.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:03.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:03.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:04.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:04.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:04.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:04.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:04.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:04.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:05.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:05.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:05.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:05.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:05.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:05.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:06.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:06.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:06.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:06.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:06.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:06.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:07.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:07.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:07.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:07.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:07.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:07.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:08.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:08.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:08.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:08.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:08.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:08.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:09.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:09.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:09.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:09.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:09.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:09.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:10.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:10.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:10.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:10.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:10.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:10.868+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:11.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:11.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:11.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:11.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:11.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:11.836+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:12.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:12.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:12.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:12.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:12.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:12.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:13.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:13.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:13.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:13.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:13.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:13.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:14.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:14.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:14.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:14.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:14.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:14.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:15.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:15.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:15.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:15.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:15.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:15.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:16.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:16.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:16.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:16.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:16.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:16.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:17.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:17.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:17.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:17.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:17.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:17.868+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:18.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:18.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:18.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:18.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:18.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:18.884+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:19.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:19.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:19.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:19.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:19.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:19.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:20.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:20.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:20.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:20.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:20.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:20.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:21.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:21.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:21.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:21.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:21.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:21.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:22.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:22.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:22.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:22.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:22.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:22.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:23.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:23.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:23.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:23.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:23.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:23.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:24.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:24.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:24.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:24.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:24.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:24.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:25.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:25.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:25.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:25.492+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:25.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:25.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:26.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:26.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:26.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:26.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:26.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:26.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:27.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:27.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:27.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:27.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:27.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:27.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:28.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:28.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:28.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:28.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:29.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:29.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:29.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:29.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:29.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:29.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:30.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:30.012+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:30.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:30.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:30.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:30.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:31.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:31.052+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:31.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:31.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:31.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:31.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:32.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:32.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:32.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:32.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:32.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:32.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:33.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:33.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:33.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:33.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:33.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:33.508+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:34.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:34.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:34.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:34.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:34.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:34.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:35.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:35.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:35.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:35.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:35.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:35.524+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:36.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:36.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:36.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:36.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:36.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:36.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:37.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:37.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:37.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:37.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:37.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:37.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:38.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:38.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:38.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:38.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:38.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:38.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:39.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:39.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:39.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:39.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:39.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:39.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:40.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:40.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:40.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:40.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:40.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:40.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:41.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:41.016+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:41.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:41.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:41.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:41.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:41.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:41.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:42.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:42.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:42.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:42.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:43.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:43.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:43.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:43.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:43.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:43.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:43.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:43.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:44.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:44.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:44.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:44.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:44.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:44.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:45.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:45.272+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:45.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:45.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:45.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:45.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:46.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:46.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:46.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:46.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:47.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:47.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:47.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:47.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:47.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:47.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:47.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:47.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:48.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:48.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:48.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:48.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:49.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:49.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:49.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:49.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:49.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:49.492+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:50.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:50.052+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:50.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:50.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:50.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:50.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:51.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:51.088+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:51.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:51.280+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:51.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:51.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:52.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:52.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:52.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:52.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:52.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:52.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:53.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:53.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:53.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:53.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:53.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:53.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:54.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:54.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:54.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:54.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:54.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:54.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:55.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:55.139+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:55.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:55.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:55.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:55.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:56.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:56.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:56.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:56.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:56.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:56.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:57.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:57.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:57.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:57.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:57.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:57.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:58.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:58.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:58.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:58.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:58.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:58.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:58.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:58.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:45:59.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:45:59.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:59.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:45:59.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:45:59.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:45:59.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:00.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:00.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:00.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:00.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:00.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:00.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:01.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:01.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:01.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:01.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:02.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:02.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:02.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:02.303+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:02.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:02.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:02.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:02.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:03.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:03.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:03.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:03.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:04.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:04.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:04.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:04.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:04.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:04.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:05.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:05.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:05.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:05.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:05.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:05.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:06.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:06.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:06.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:06.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:06.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:06.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:07.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:07.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:07.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:07.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:07.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:07.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:07.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:07.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:08.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:08.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:08.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:08.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:08.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:08.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:09.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:09.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:09.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:09.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:09.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:09.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:10.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:10.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:10.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:10.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:10.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:10.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:11.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:11.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:11.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:11.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:11.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:11.883+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:12.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:12.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:12.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:12.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:12.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:12.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:13.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:13.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:13.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:13.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:13.883 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:13.879+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:14.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:14.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:14.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:14.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:14.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:14.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:15.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:15.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:15.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:15.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:15.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:15.887+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:16.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:16.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:16.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:16.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:16.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:16.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:17.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:17.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:17.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:17.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:17.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:17.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:18.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:18.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:18.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:18.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:18.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:18.819+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:19.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:19.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:19.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:19.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:19.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:19.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:20.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:20.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:20.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:20.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:20.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:20.819+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:21.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:21.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:21.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:21.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:21.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:21.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:22.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:22.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:22.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:22.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:22.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:22.899+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:23.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:23.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:23.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:23.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:23.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:23.887+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:24.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:24.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:24.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:24.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:24.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:24.911+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:25.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:25.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:25.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:25.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:25.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:25.927+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:26.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:26.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:26.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:26.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:26.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:26.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:27.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:27.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:27.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:27.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:27.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:27.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:28.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:28.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:28.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:28.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:28.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:28.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:29.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:29.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:29.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:29.395+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:29.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:29.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:30.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:30.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:30.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:30.403+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:30.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:30.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:31.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:31.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:31.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:31.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:31.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:31.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:32.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:32.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:32.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:32.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:32.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:32.895+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:33.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:33.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:33.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:33.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:33.860 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:33.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:34.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:34.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:34.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:34.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:34.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:34.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:35.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:35.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:35.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:35.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:35.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:35.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:36.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:36.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:36.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:36.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:36.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:36.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:37.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:37.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:37.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:37.275+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:37.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:37.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:38.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:38.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:38.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:38.250+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:38.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:38.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:39.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:39.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:39.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:39.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:39.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:39.810+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:40.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:40.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:40.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:40.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:40.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:40.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:41.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:41.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:41.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:41.282+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:41.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:41.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:42.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:42.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:42.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:42.330+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:42.809 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:42.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:43.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:43.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:43.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:43.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:43.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:43.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:44.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:44.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:44.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:44.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:44.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:44.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:45.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:45.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:45.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:45.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:45.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:45.770+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:46.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:46.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:46.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:46.298+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:46.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:46.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:47.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:47.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:47.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:47.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:47.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:47.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:48.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:48.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:48.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:48.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:48.869 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:48.862+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:49.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:49.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:49.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:49.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:49.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:49.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:50.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:50.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:50.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:50.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:50.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:50.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:51.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:51.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:51.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:51.310+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:51.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:51.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:52.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:52.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:52.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:52.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:52.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:52.846+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:53.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:53.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:53.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:53.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:53.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:53.842+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:54.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:54.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:54.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:54.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:54.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:54.854+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:55.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:55.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:55.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:55.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:55.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:55.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:56.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:56.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:56.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:56.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:56.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:56.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:57.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:57.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:57.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:57.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:57.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:57.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:58.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:58.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:58.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:58.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:58.907 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:58.902+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:46:59.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:46:59.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:59.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:46:59.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:46:59.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:46:59.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:00.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:00.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:00.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:00.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:00.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:00.878+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:01.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:01.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:01.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:01.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:01.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:01.842+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:02.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:02.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:02.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:02.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:02.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:02.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:03.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:03.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:03.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:03.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:03.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:03.858+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:04.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:04.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:04.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:04.222+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:04.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:04.854+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:05.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:05.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:05.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:05.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:05.863 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:05.858+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:06.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:06.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:06.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:06.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:06.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:06.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:07.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:07.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:07.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:07.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:07.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:07.898+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:08.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:08.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:08.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:08.186+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:08.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:08.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:09.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:09.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:09.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:09.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:09.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:09.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:10.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:10.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:10.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:10.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:10.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:10.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:11.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:11.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:11.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:11.310+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:11.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:11.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:12.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:12.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:12.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:12.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:12.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:12.938+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:13.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:13.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:13.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:13.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:13.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:13.950+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:14.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:14.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:14.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:14.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:14.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:14.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:15.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:15.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:15.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:15.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:15.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:15.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:16.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:16.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:16.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:16.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:16.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:16.930+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:17.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:17.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:17.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:17.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:17.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:17.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:18.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:18.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:18.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:18.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:18.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:18.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:19.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:19.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:19.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:19.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:19.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:19.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:20.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:20.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:20.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:20.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:20.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:20.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:21.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:21.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:21.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:21.250+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:21.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:21.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:22.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:22.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:22.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:22.298+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:22.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:22.902+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:23.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:23.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:23.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:23.330+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:23.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:23.894+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:24.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:24.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:24.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:24.294+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:24.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:24.929+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:25.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:25.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:25.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:25.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:25.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:25.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:26.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:26.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:26.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:26.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:26.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:26.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:27.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:27.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:27.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:27.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:27.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:27.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:28.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:28.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:28.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:28.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:28.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:28.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:29.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:29.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:29.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:29.253+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:29.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:29.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:30.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:30.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:30.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:30.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:30.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:30.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:31.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:31.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:31.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:31.245+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:31.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:31.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:32.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:32.197+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:32.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:32.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:32.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:32.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:33.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:33.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:33.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:33.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:34.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:34.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:34.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:34.245+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:34.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:34.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:35.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:35.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:35.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:35.245+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:35.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:35.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:36.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:36.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:36.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:36.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:36.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:36.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:37.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:37.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:37.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:37.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:37.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:37.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:38.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:38.109+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:38.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:38.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:38.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:38.297+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:39.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:39.105+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:39.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:39.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:39.317 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:39.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:40.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:40.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:40.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:40.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:40.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:40.297+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:41.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:41.097+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:41.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:41.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:41.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:41.285+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:42.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:42.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:42.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:42.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:42.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:42.321+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:43.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:43.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:43.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:43.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:43.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:43.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:44.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:44.149+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:44.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:44.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:44.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:44.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:45.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:45.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:45.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:45.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:45.400 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:45.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:46.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:46.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:46.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:46.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:46.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:46.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:47.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:47.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:47.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:47.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:47.400 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:47.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:48.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:48.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:48.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:48.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:48.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:48.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:49.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:49.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:49.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:49.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:49.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:49.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:50.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:50.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:50.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:50.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:50.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:50.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:51.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:51.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:51.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:51.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:51.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:51.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:52.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:52.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:52.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:52.253+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:52.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:52.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:53.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:53.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:53.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:53.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:53.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:53.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:54.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:54.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:54.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:54.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:54.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:54.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:55.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:55.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:55.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:55.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:55.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:55.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:56.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:56.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:56.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:56.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:56.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:56.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:57.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:57.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:57.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:57.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:57.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:57.481+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:58.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:58.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:58.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:58.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:58.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:58.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:59.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:47:59.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:47:59.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:47:59.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:47:59.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:47:59.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:00.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:00.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:00.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:00.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:00.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:00.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:01.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:01.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:01.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:01.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:01.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:01.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:02.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:02.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:02.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:02.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:02.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:02.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:03.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:03.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:03.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:03.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:03.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:03.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:04.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:04.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:04.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:04.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:04.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:04.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:05.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:05.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:05.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:05.053+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:05.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:05.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:06.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:06.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:06.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:06.053+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:06.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:06.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:07.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:07.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:07.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:07.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:07.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:07.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:08.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:08.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:08.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:08.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:08.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:08.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:09.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:09.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:09.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:09.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:09.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:09.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:10.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:10.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:10.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:10.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:10.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:10.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:11.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:11.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:11.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:11.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:11.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:11.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:12.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:12.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:12.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:12.144+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:12.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:12.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:13.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:13.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:13.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:13.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:13.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:13.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:14.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:14.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:14.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:14.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:14.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:14.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:15.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:15.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:15.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:15.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:15.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:15.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:16.005 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:16.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:16.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:16.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:16.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:16.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:17.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:17.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:17.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:17.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:17.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:17.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:17.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:17.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:18.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:18.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:18.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:18.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:18.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:18.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:19.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:19.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:19.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:19.328+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:20.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:20.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:20.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:20.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:20.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:20.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:21.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:21.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:21.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:21.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:21.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:21.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:22.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:22.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:22.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:22.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:22.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:22.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:23.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:23.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:23.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:23.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:23.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:23.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:24.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:24.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:24.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:24.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:24.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:24.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:25.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:25.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:25.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:25.100+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:25.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:25.344+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:26.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:26.044+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:26.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:26.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:26.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:26.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:27.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:27.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:27.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:27.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:27.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:27.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:27.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:27.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:28.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:28.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:28.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:28.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:29.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:29.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:29.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:29.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:29.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:29.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:29.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:29.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:29.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:29.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:30.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:30.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:30.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:30.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:31.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:31.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:31.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:31.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:31.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:31.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:32.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:32.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:32.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:32.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:32.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:32.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:33.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:33.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:33.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:33.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:33.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:33.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:33.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:33.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:34.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:34.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:34.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:34.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:34.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:34.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:35.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:35.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:35.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:35.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:35.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:35.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:36.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:36.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:36.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:36.920+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:36.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:36.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:37.364 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:37.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:37.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:37.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:37.959 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:37.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:38.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:38.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:38.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:38.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:38.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:38.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:39.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:39.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:39.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:39.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:39.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:39.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:40.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:40.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:40.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:40.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:41.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:41.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:41.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:41.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:41.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:41.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:42.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:42.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:42.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:42.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:42.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:42.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:43.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:43.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:43.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:43.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:43.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:43.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:44.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:44.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:44.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:44.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:44.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:44.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:45.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:45.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:45.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:45.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:45.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:45.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:46.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:46.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:46.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:46.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:46.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:46.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:47.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:47.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:47.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:47.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:47.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:47.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:48.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:48.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:48.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:48.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:48.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:48.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:49.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:49.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:49.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:49.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:49.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:49.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:50.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:50.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:50.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:50.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:50.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:50.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:51.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:51.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:51.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:51.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:51.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:51.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:52.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:52.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:52.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:52.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:52.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:52.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:53.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:53.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:53.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:53.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:53.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:53.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:54.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:54.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:54.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:54.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:54.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:54.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:55.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:55.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:55.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:55.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:55.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:55.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:56.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:56.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:56.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:56.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:56.905 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:56.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:57.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:57.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:57.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:57.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:57.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:57.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:58.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:58.015+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:58.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:58.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:58.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:58.883+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:48:59.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:48:59.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:59.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:48:59.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:48:59.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:48:59.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:00.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:00.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:00.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:00.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:00.831 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:00.827+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:01.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:01.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:01.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:01.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:01.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:01.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:02.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:02.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:02.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:02.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:02.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:02.747+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:03.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:03.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:03.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:03.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:03.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:03.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:04.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:04.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:04.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:04.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:04.728 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:04.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:05.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:05.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:05.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:05.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:05.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:05.739+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:06.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:06.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:06.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:06.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:06.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:06.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:07.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:07.107+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:07.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:07.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:07.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:07.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:08.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:08.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:08.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:08.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:08.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:08.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:09.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:09.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:09.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:09.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:09.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:09.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:10.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:10.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:10.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:10.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:10.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:10.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:11.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:11.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:11.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:11.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:11.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:11.887+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:12.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:12.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:12.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:12.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:12.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:12.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:13.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:13.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:13.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:13.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:13.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:13.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:14.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:14.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:14.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:14.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:14.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:14.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:15.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:15.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:15.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:15.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:15.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:15.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:16.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:16.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:16.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:16.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:16.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:16.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:17.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:17.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:17.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:17.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:17.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:17.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:18.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:18.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:18.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:18.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:18.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:18.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:19.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:19.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:19.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:19.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:19.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:19.959+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:20.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:20.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:20.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:20.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:20.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:20.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:21.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:21.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:21.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:21.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:21.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:21.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:22.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:22.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:22.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:22.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:22.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:22.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:23.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:23.303+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:23.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:23.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:23.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:23.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:24.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:24.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:24.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:24.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:24.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:24.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:25.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:25.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:25.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:25.387+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:26.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:26.007+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:26.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:26.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:26.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:26.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:27.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:27.007+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:27.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:27.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:27.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:27.387+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:28.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:28.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:28.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:28.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:28.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:28.371+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:29.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:29.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:29.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:29.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:29.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:29.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:30.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:30.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:30.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:30.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:30.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:30.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:31.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:31.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:31.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:31.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:31.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:31.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:32.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:32.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:32.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:32.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:32.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:32.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:33.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:33.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:33.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:33.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:33.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:33.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:34.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:34.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:34.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:34.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:34.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:34.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:35.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:35.091+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:35.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:35.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:35.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:35.483+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:36.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:36.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:36.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:36.303+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:36.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:36.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:37.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:37.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:37.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:37.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:37.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:37.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:38.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:38.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:38.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:38.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:38.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:38.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:39.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:39.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:39.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:39.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:39.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:39.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:40.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:40.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:40.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:40.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:40.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:40.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:41.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:41.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:41.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:41.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:41.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:41.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:42.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:42.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:42.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:42.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:42.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:42.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:43.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:43.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:43.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:43.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:43.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:43.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:44.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:44.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:44.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:44.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:44.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:44.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:45.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:45.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:45.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:45.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:45.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:45.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:46.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:46.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:46.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:46.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:46.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:46.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:47.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:47.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:47.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:47.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:47.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:47.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:48.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:48.002+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:48.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:48.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:48.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:48.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:49.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:49.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:49.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:49.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:49.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:49.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:50.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:50.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:50.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:50.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:50.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:50.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:51.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:51.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:51.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:51.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:51.488 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:51.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:52.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:52.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:52.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:52.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:52.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:52.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:53.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:53.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:53.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:53.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:53.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:53.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:54.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:54.058+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:54.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:54.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:54.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:54.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:55.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:55.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:55.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:55.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:55.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:55.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:56.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:56.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:56.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:56.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:56.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:56.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:57.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:57.002+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:57.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:57.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:57.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:57.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:58.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:57.994+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:58.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:58.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:58.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:58.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:59.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:58.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:49:59.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:49:59.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:59.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:49:59.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:49:59.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:49:59.986+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:00.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:00.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:00.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:00.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:01.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:01.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:01.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:01.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:01.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:01.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:02.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:02.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:02.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:02.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:02.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:02.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:03.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:03.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:03.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:03.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:03.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:03.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:03.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:03.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:04.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:04.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:04.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:04.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:05.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:04.994+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:05.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:05.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:05.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:05.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:05.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:05.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:06.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:06.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:06.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:06.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:06.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:06.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:07.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:07.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:07.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:07.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:07.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:07.958+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:08.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:08.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:08.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:08.338+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:08.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:08.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:09.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:09.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:09.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:09.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:09.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:09.894+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:10.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:10.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:10.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:10.330+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:10.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:10.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:11.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:11.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:11.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:11.338+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:11.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:11.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:12.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:12.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:12.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:12.310+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:12.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:12.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:13.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:13.034+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:13.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:13.290+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:13.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:13.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:14.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:14.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:14.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:14.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:14.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:14.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:14.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:14.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:15.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:15.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:15.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:15.938+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:15.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:15.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:16.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:16.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:16.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:16.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:17.017 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:17.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:17.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:17.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:17.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:17.958+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:18.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:18.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:18.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:18.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:18.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:18.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:19.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:19.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:19.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:19.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:19.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:19.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:20.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:20.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:20.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:20.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:20.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:20.842+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:21.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:21.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:21.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:21.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:21.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:21.798+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:22.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:22.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:22.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:22.366+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:22.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:22.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:23.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:23.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:23.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:23.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:23.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:23.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:24.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:24.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:24.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:24.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:24.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:24.758+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:25.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:25.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:25.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:25.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:25.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:25.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:26.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:26.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:26.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:26.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:26.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:26.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:27.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:27.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:27.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:27.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:27.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:27.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:28.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:28.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:28.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:28.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:28.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:28.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:29.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:29.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:29.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:29.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:29.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:29.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:30.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:30.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:30.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:30.369+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:30.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:30.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:31.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:31.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:31.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:31.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:31.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:31.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:32.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:32.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:32.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:32.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:32.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:32.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:33.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:33.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:33.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:33.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:33.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:33.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:34.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:34.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:34.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:34.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:34.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:34.973+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:35.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:35.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:35.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:35.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:35.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:35.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:36.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:36.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:36.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:36.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:36.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:36.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:37.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:37.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:37.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:37.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:38.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:38.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:38.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:38.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:38.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:38.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:39.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:39.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:39.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:39.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:39.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:39.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:40.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:40.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:40.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:40.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:40.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:40.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:41.019 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:41.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:41.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:41.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:41.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:41.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:42.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:42.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:42.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:42.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:42.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:42.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:43.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:43.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:43.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:43.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:43.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:43.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:44.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:44.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:44.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:44.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:44.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:44.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:44.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:44.997+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:45.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:45.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:45.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:45.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:45.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:45.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:46.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:46.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:46.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:46.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:46.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:46.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:47.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:47.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:47.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:47.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:47.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:47.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:48.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:48.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:48.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:48.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:48.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:48.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:49.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:49.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:49.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:49.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:49.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:49.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:50.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:50.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:50.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:50.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:50.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:50.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:51.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:51.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:51.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:51.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:51.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:51.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:52.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:52.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:52.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:52.621+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:53.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:53.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:53.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:53.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:53.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:53.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:53.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:53.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:54.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:54.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:54.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:54.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:55.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:55.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:55.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:55.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:55.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:55.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:56.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:56.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:56.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:56.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:56.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:56.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:57.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:57.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:57.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:57.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:57.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:57.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:58.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:58.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:58.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:58.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:58.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:58.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:59.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:50:59.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:50:59.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:50:59.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:50:59.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:50:59.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:00.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:00.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:00.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:00.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:00.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:00.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:01.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:01.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:01.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:01.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:01.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:01.625+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:02.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:02.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:02.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:02.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:02.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:02.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:03.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:03.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:03.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:03.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:03.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:03.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:04.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:04.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:04.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:04.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:04.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:04.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:05.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:05.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:05.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:05.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:05.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:05.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:06.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:06.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:06.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:06.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:06.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:06.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:07.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:07.133+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:07.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:07.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:07.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:07.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:08.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:08.133+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:08.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:08.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:08.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:08.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:09.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:09.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:09.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:09.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:09.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:09.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:10.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:10.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:10.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:10.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:10.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:10.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:11.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:11.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:11.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:11.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:11.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:11.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:12.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:12.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:12.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:12.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:12.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:12.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:13.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:13.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:13.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:13.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:13.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:13.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:14.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:14.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:14.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:14.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:14.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:14.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:15.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:15.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:15.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:15.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:15.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:15.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:16.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:16.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:16.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:16.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:16.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:16.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:17.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:17.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:17.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:17.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:17.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:17.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:18.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:18.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:18.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:18.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:18.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:18.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:19.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:19.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:19.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:19.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:19.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:19.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:20.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:20.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:20.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:20.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:20.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:20.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:21.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:21.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:21.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:21.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:21.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:21.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:22.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:22.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:22.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:22.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:22.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:22.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:23.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:23.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:23.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:23.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:23.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:23.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:24.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:24.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:24.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:24.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:24.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:24.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:25.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:25.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:25.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:25.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:25.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:25.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:26.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:26.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:26.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:26.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:26.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:26.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:27.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:27.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:27.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:27.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:27.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:27.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:28.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:28.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:28.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:28.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:28.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:28.648+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:29.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:29.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:29.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:29.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:29.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:29.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:30.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:30.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:30.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:30.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:30.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:30.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:31.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:31.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:31.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:31.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:31.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:31.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:32.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:32.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:32.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:32.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:32.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:32.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:33.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:33.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:33.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:33.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:33.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:33.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:34.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:34.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:34.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:34.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:34.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:34.648+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:35.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:35.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:35.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:35.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:35.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:35.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:36.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:36.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:36.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:36.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:36.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:36.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:37.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:37.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:37.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:37.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:37.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:37.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:38.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:38.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:38.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:38.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:38.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:38.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:39.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:39.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:39.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:39.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:39.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:39.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:40.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:40.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:40.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:40.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:40.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:40.668+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:41.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:41.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:41.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:41.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:41.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:41.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:42.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:42.280+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:42.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:42.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:42.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:42.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:43.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:43.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:43.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:43.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:43.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:43.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:44.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:44.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:44.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:44.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:44.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:44.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:45.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:45.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:45.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:45.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:45.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:45.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:46.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:46.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:46.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:46.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:46.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:46.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:47.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:47.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:47.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:47.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:47.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:47.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:48.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:48.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:48.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:48.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:48.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:48.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:49.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:49.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:49.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:49.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:49.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:49.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:50.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:50.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:50.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:50.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:50.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:50.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:51.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:51.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:51.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:51.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:51.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:51.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:52.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:52.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:52.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:52.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:52.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:52.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:53.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:53.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:53.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:53.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:53.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:53.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:54.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:54.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:54.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:54.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:54.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:54.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:55.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:55.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:55.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:55.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:55.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:55.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:56.363 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:56.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:56.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:56.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:56.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:56.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:57.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:57.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:57.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:57.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:57.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:57.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:58.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:58.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:58.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:58.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:58.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:58.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:59.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:51:59.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:51:59.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:51:59.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:51:59.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:51:59.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:00.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:00.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:00.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:00.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:00.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:00.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:01.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:01.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:01.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:01.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:01.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:01.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:02.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:02.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:02.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:02.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:02.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:02.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:03.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:03.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:03.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:03.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:03.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:03.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:04.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:04.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:04.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:04.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:04.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:04.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:05.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:05.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:05.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:05.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:05.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:05.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:06.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:06.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:06.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:06.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:06.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:06.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:07.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:07.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:07.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:07.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:07.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:07.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:08.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:08.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:08.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:08.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:08.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:08.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:09.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:09.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:09.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:09.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:09.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:09.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:10.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:10.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:10.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:10.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:10.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:10.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:11.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:11.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:11.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:11.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:11.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:11.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:12.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:12.331+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:12.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:12.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:12.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:12.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:13.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:13.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:13.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:13.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:13.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:13.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:14.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:14.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:14.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:14.423+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:14.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:14.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:15.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:15.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:15.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:15.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:15.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:15.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:16.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:16.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:16.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:16.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:16.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:16.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:17.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:17.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:17.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:17.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:17.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:17.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:18.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:18.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:18.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:18.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:18.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:18.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:19.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:19.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:19.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:19.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:19.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:19.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:20.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:20.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:20.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:20.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:20.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:20.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:21.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:21.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:21.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:21.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:21.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:21.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:22.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:22.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:22.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:22.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:22.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:22.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:23.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:23.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:23.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:23.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:23.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:23.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:24.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:24.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:24.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:24.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:24.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:24.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:25.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:25.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:25.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:25.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:25.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:25.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:26.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:26.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:26.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:26.423+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:26.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:26.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:27.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:27.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:27.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:27.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:27.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:27.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:28.228 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:28.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:28.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:28.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:28.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:28.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:29.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:29.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:29.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:29.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:29.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:29.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:30.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:30.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:30.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:30.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:30.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:30.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:31.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:31.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:31.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:31.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:31.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:31.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:32.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:32.127+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:32.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:32.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:32.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:32.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:33.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:33.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:33.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:33.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:33.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:33.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:34.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:34.195+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:34.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:34.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:34.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:34.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:35.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:35.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:35.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:35.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:35.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:35.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:36.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:36.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:36.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:36.419+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:36.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:36.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:37.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:37.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:37.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:37.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:37.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:37.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:38.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:38.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:38.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:38.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:38.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:38.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:39.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:39.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:39.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:39.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:39.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:39.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:40.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:40.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:40.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:40.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:40.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:40.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:41.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:41.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:41.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:41.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:41.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:41.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:42.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:42.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:42.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:42.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:42.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:42.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:43.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:43.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:43.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:43.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:43.929 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:43.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:44.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:44.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:44.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:44.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:44.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:44.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:45.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:45.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:45.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:45.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:45.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:45.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:46.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:46.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:46.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:46.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:46.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:46.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:47.381 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:47.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:47.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:47.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:47.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:47.899+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:48.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:48.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:48.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:48.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:48.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:48.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:49.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:49.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:49.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:49.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:49.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:49.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:50.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:50.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:50.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:50.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:50.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:50.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:51.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:51.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:51.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:51.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:51.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:51.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:52.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:52.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:52.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:52.475+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:52.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:52.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:53.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:53.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:53.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:53.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:53.884 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:53.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:54.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:54.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:54.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:54.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:54.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:54.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:55.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:55.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:55.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:55.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:55.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:55.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:56.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:56.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:56.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:56.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:56.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:56.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:57.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:57.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:57.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:57.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:57.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:57.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:58.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:58.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:58.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:58.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:58.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:58.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:59.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:52:59.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:52:59.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:52:59.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:52:59.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:52:59.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:00.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:00.390+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:00.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:00.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:00.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:00.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:01.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:01.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:01.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:01.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:01.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:01.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:02.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:02.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:02.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:02.442+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:02.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:02.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:03.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:03.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:03.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:03.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:03.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:03.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:04.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:04.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:04.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:04.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:04.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:04.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:05.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:05.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:05.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:05.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:05.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:05.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:06.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:06.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:06.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:06.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:06.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:06.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:07.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:07.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:07.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:07.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:07.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:07.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:08.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:08.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:08.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:08.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:08.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:08.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:09.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:09.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:09.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:09.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:09.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:09.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:10.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:10.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:10.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:10.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:10.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:10.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:11.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:11.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:11.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:11.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:11.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:11.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:12.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:12.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:12.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:12.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:12.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:12.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:13.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:13.446+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:13.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:13.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:13.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:13.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:14.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:14.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:14.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:14.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:14.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:14.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:15.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:15.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:15.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:15.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:15.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:15.894+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:16.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:16.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:16.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:16.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:16.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:16.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:17.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:17.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:17.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:17.478+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:17.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:17.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:18.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:18.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:18.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:18.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:18.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:18.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:19.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:19.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:19.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:19.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:19.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:19.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:20.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:20.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:20.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:20.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:20.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:20.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:21.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:21.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:21.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:21.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:21.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:21.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:22.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:22.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:22.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:22.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:22.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:22.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:23.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:23.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:23.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:23.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:23.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:23.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:24.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:24.422+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:24.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:24.478+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:24.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:24.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:25.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:25.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:25.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:25.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:25.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:25.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:26.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:26.394+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:26.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:26.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:26.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:26.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:27.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:27.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:27.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:27.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:27.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:27.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:28.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:28.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:28.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:28.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:28.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:28.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:29.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:29.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:29.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:29.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:29.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:29.898+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:30.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:30.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:30.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:30.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:30.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:30.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:31.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:31.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:31.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:31.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:31.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:31.934+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:32.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:32.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:32.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:32.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:32.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:32.930+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:33.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:33.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:33.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:33.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:33.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:33.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:34.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:34.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:34.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:34.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:34.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:34.958+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:35.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:35.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:35.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:35.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:35.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:35.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:36.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:36.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:36.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:36.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:36.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:36.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:37.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:37.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:37.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:37.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:37.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:37.938+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:38.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:38.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:38.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:38.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:38.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:38.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:39.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:39.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:39.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:39.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:39.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:39.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:40.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:40.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:40.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:40.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:40.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:40.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:41.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:41.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:41.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:41.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:41.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:41.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:42.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:42.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:42.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:42.493+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:42.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:42.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:43.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:43.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:43.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:43.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:43.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:43.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:44.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:44.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:44.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:44.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:44.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:44.873+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:45.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:45.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:45.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:45.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:45.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:45.905+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:46.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:46.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:46.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:46.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:46.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:46.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:47.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:47.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:47.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:47.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:47.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:47.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:48.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:48.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:48.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:48.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:48.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:48.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:49.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:49.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:49.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:49.493+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:49.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:49.905+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:50.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:50.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:50.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:50.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:50.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:50.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:51.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:51.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:51.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:51.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:51.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:51.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:52.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:52.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:52.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:52.553+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:52.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:52.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:53.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:53.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:53.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:53.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:53.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:53.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:54.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:54.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:54.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:54.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:54.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:54.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:55.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:55.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:55.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:55.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:55.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:55.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:56.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:56.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:56.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:56.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:56.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:56.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:57.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:57.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:57.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:57.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:57.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:57.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:58.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:58.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:58.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:58.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:58.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:58.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:59.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:53:59.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:53:59.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:53:59.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:53:59.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:53:59.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:00.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:00.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:00.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:00.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:00.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:00.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:01.291 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:01.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:01.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:01.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:01.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:01.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:02.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:02.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:02.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:02.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:02.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:02.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:03.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:03.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:03.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:03.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:03.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:03.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:04.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:04.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:04.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:04.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:04.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:04.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:05.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:05.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:05.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:05.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:05.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:05.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:06.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:06.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:06.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:06.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:06.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:06.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:07.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:07.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:07.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:07.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:07.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:07.813+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:08.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:08.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:08.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:08.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:08.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:08.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:09.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:09.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:09.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:09.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:09.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:09.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:10.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:10.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:10.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:10.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:10.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:10.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:11.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:11.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:11.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:11.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:11.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:11.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:12.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:12.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:12.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:12.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:12.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:12.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:13.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:13.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:13.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:13.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:13.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:13.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:14.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:14.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:14.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:14.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:14.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:14.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:15.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:15.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:15.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:15.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:15.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:15.869+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:16.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:16.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:16.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:16.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:16.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:16.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:17.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:17.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:17.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:17.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:17.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:17.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:18.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:18.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:18.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:18.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:18.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:18.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:19.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:19.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:19.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:19.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:19.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:19.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:20.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:20.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:20.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:20.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:20.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:20.869+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:21.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:21.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:21.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:21.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:21.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:21.865+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:22.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:22.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:22.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:22.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:22.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:22.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:23.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:23.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:23.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:23.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:23.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:23.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:24.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:24.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:24.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:24.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:24.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:24.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:25.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:25.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:25.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:25.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:25.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:25.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:26.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:26.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:26.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:26.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:26.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:26.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:27.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:27.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:27.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:27.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:27.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:27.881+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:28.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:28.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:28.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:28.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:28.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:28.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:29.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:29.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:29.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:29.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:29.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:29.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:30.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:30.168+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:30.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:30.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:30.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:30.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:31.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:31.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:31.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:31.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:31.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:31.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:32.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:32.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:32.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:32.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:32.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:32.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:33.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:33.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:33.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:33.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:33.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:33.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:34.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:34.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:34.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:34.728+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:35.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:35.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:35.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:35.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:35.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:35.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:36.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:36.048+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:36.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:36.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:36.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:36.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:37.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:37.052+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:37.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:37.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:37.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:37.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:38.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:38.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:38.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:38.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:38.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:38.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:39.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:39.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:39.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:39.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:39.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:39.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:40.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:40.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:40.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:40.244+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:40.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:40.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:41.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:41.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:41.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:41.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:41.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:41.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:41.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:41.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:42.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:42.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:42.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:42.812+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:43.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:43.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:43.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:43.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:43.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:43.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:43.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:43.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:44.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:44.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:44.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:44.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:45.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:45.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:45.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:45.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:45.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:45.776+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:46.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:46.048+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:46.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:46.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:46.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:46.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:47.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:47.028+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:47.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:47.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:47.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:47.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:48.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:48.000+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:48.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:48.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:48.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:48.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:48.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:48.972+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:49.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:49.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:49.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:49.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:50.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:50.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:50.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:50.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:50.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:50.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:50.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:50.972+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:51.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:51.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:51.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:51.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:51.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:51.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:52.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:52.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:52.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:52.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:52.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:52.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:53.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:53.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:53.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:53.736+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:53.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:53.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:54.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:54.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:54.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:54.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:54.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:54.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:55.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:55.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:55.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:55.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:55.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:55.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:56.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:56.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:56.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:56.656+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:56.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:56.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:57.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:57.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:57.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:57.672+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:57.945 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:57.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:58.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:58.356+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:58.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:58.636+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:58.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:58.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:59.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:54:59.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:54:59.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:54:59.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:54:59.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:54:59.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:00.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:00.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:00.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:00.648+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:00.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:00.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:01.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:01.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:01.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:01.600+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:01.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:01.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:02.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:02.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:02.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:02.580+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:02.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:02.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:03.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:03.328+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:03.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:03.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:03.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:03.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:04.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:04.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:04.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:04.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:04.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:04.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:05.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:05.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:05.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:05.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:05.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:05.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:06.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:06.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:06.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:06.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:06.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:06.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:07.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:07.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:07.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:07.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:07.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:07.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:08.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:08.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:08.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:08.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:08.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:08.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:09.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:09.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:09.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:09.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:09.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:09.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:10.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:10.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:10.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:10.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:10.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:10.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:11.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:11.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:11.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:11.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:11.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:11.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:12.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:12.356+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:12.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:12.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:12.943 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:12.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:13.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:13.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:13.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:13.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:13.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:13.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:14.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:14.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:14.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:14.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:14.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:14.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:15.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:15.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:15.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:15.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:15.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:15.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:16.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:16.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:16.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:16.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:16.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:16.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:17.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:17.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:17.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:17.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:17.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:17.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:18.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:18.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:18.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:18.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:18.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:18.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:19.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:19.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:19.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:19.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:19.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:19.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:20.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:20.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:20.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:20.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:20.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:20.899+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:21.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:21.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:21.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:21.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:21.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:21.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:22.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:22.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:22.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:22.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:22.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:22.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:23.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:23.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:23.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:23.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:23.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:23.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:24.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:24.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:24.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:24.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:24.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:24.899+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:25.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:25.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:25.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:25.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:25.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:25.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:26.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:26.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:26.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:26.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:26.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:26.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:27.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:27.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:27.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:27.423+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:27.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:27.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:28.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:28.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:28.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:28.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:28.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:28.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:29.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:29.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:29.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:29.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:29.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:29.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:30.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:30.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:30.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:30.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:30.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:30.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:31.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:31.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:31.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:31.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:31.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:31.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:32.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:32.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:32.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:32.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:32.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:32.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:33.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:33.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:33.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:33.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:33.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:33.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:34.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:34.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:34.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:34.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:34.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:34.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:35.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:35.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:35.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:35.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:35.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:35.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:36.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:36.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:36.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:36.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:36.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:36.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:37.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:37.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:37.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:37.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:37.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:37.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:38.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:38.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:38.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:38.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:38.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:38.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:39.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:39.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:39.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:39.635+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:39.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:39.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:40.291 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:40.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:40.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:40.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:40.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:40.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:41.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:41.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:41.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:41.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:41.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:41.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:42.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:42.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:42.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:42.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:42.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:42.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:43.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:43.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:43.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:43.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:43.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:43.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:44.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:44.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:44.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:44.663+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:44.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:44.907+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:45.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:45.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:45.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:45.675+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:45.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:45.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:46.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:46.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:46.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:46.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:46.860 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:46.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:47.344 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:47.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:47.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:47.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:47.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:47.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:48.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:48.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:48.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:48.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:48.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:48.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:49.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:49.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:49.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:49.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:49.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:49.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:50.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:50.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:50.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:50.739+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:50.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:50.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:51.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:51.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:51.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:51.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:51.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:51.927+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:52.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:52.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:52.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:52.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:52.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:52.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:53.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:53.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:53.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:53.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:53.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:53.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:54.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:54.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:54.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:54.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:54.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:54.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:55.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:55.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:55.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:55.775+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:55.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:55.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:56.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:56.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:56.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:56.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:56.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:56.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:57.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:57.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:57.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:57.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:57.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:57.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:58.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:58.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:58.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:58.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:58.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:58.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:59.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:55:59.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:55:59.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:55:59.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:55:59.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:55:59.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:00.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:00.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:00.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:00.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:00.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:00.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:01.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:01.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:01.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:01.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:01.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:01.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:02.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:02.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:02.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:02.739+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:02.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:02.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:03.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:03.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:03.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:03.783+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:03.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:03.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:04.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:04.127+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:04.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:04.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:04.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:04.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:05.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:05.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:05.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:05.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:05.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:05.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:06.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:06.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:06.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:06.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:06.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:06.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:07.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:07.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:07.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:07.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:07.884 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:07.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:08.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:08.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:08.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:08.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:08.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:08.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:09.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:09.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:09.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:09.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:09.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:09.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:10.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:10.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:10.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:10.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:10.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:10.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:11.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:11.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:11.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:11.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:12.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:12.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:12.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:12.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:12.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:12.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:13.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:13.046+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:13.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:13.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:13.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:13.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:14.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:14.046+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:14.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:14.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:14.904 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:14.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:15.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:15.006+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:15.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:15.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:15.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:15.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:16.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:15.998+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:16.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:16.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:16.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:16.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:17.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:17.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:17.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:17.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:17.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:17.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:18.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:18.050+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:18.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:18.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:18.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:18.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:19.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:19.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:19.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:19.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:19.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:19.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:20.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:20.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:20.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:20.350+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:20.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:20.906+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:21.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:21.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:21.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:21.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:21.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:21.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:22.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:22.038+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:22.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:22.370+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:22.890 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:22.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:23.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:23.026+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:23.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:23.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:23.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:23.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:24.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:24.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:24.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:24.354+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:24.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:24.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:25.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:25.054+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:25.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:25.314+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:25.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:25.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:26.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:26.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:26.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:26.350+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:27.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:26.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:27.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:27.042+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:27.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:27.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:28.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:28.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:28.066 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:28.058+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:28.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:28.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:28.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:28.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:29.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:29.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:29.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:29.390+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:30.020 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:30.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:30.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:30.134+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:30.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:30.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:30.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:30.974+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:31.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:31.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:31.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:31.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:32.005 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:31.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:32.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:32.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:32.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:32.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:33.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:33.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:33.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:33.214+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:33.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:33.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:34.015 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:34.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:34.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:34.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:34.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:34.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:34.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:34.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:35.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:35.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:35.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:35.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:35.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:35.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:36.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:36.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:36.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:36.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:36.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:36.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:37.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:37.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:37.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:37.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:37.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:37.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:38.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:38.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:38.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:38.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:38.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:38.906+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:39.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:39.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:39.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:39.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:39.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:39.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:40.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:40.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:40.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:40.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:40.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:40.878+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:41.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:41.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:41.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:41.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:41.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:41.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:42.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:42.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:42.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:42.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:42.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:42.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:43.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:43.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:43.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:43.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:43.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:43.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:44.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:44.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:44.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:44.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:44.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:44.934+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:45.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:45.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:45.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:45.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:45.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:45.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:46.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:46.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:46.683 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:46.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:46.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:46.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:47.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:47.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:47.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:47.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:47.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:47.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:48.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:48.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:48.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:48.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:48.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:48.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:49.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:49.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:49.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:49.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:49.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:49.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:50.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:50.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:50.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:50.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:50.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:50.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:51.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:51.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:51.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:51.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:51.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:51.878+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:52.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:52.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:52.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:52.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:52.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:52.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:53.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:53.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:53.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:53.677+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:53.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:53.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:54.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:54.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:54.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:54.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:54.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:54.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:55.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:55.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:55.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:55.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:56.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:55.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:56.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:56.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:56.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:56.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:56.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:56.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:57.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:57.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:57.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:57.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:57.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:57.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:58.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:58.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:58.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:58.705+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:58.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:58.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:59.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:56:59.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:56:59.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:56:59.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:56:59.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:56:59.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:00.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:00.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:00.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:00.725+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:00.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:00.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:01.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:01.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:01.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:01.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:01.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:01.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:02.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:02.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:02.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:02.705+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:02.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:02.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:02.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:02.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:03.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:03.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:03.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:03.901+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:03.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:03.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:04.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:04.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:04.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:04.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:04.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:04.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:05.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:05.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:05.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:05.885+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:05.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:05.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:06.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:06.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:06.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:06.893+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:06.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:06.921+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:07.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:07.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:07.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:07.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:07.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:07.929+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:08.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:08.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:08.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:08.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:08.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:08.893+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:09.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:09.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:09.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:09.809+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:09.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:09.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:10.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:10.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:10.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:10.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:10.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:10.905+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:11.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:11.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:11.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:11.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:11.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:11.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:12.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:12.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:12.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:12.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:12.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:12.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:13.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:13.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:13.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:13.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:13.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:13.889+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:14.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:14.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:14.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:14.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:14.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:14.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:15.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:15.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:15.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:15.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:15.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:15.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:16.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:16.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:16.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:16.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:16.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:16.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:17.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:17.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:17.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:17.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:17.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:17.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:18.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:18.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:18.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:18.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:18.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:18.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:19.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:19.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:19.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:19.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:19.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:19.893+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:20.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:20.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:20.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:20.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:20.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:20.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:21.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:21.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:21.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:21.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:21.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:21.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:22.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:22.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:22.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:22.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:22.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:22.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:23.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:23.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:23.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:23.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:23.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:23.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:24.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:24.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:24.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:24.677+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:25.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:25.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:25.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:25.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:25.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:25.657+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:26.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:26.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:26.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:26.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:26.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:26.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:26.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:26.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:27.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:27.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:27.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:27.633+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:28.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:28.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:28.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:28.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:28.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:28.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:29.027 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:29.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:29.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:29.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:29.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:29.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:30.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:30.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:30.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:30.629+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:30.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:30.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:31.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:31.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:31.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:31.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:31.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:31.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:31.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:31.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:32.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:32.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:32.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:32.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:33.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:33.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:33.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:33.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:33.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:33.681+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:33.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:33.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:34.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:34.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:34.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:34.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:34.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:34.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:35.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:35.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:35.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:35.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:35.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:35.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:36.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:36.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:36.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:36.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:36.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:36.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:37.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:37.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:37.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:37.749+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:37.917 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:37.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:38.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:38.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:38.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:38.793+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:38.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:38.925+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:39.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:39.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:39.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:39.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:39.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:39.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:40.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:40.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:40.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:40.728+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:40.860 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:40.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:41.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:41.680+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:41.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:41.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:41.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:41.864+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:42.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:42.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:42.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:42.692+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:42.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:42.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:43.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:43.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:43.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:43.732+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:43.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:43.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:44.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:44.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:44.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:44.744+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:44.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:44.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:45.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:45.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:45.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:45.708+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:45.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:45.820+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:46.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:46.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:46.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:46.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:46.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:46.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:47.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:47.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:47.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:47.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:47.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:47.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:48.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:48.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:48.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:48.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:48.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:48.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:49.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:49.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:49.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:49.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:49.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:49.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:50.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:50.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:50.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:50.736+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:50.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:50.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:51.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:51.712+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:51.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:51.736+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:51.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:51.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:52.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:52.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:52.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:52.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:52.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:52.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:53.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:53.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:53.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:53.772+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:53.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:53.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:54.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:54.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:54.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:54.792+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:54.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:54.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:55.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:55.780+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:55.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:55.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:55.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:55.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:56.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:56.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:56.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:56.772+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:56.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:56.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:57.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:57.772+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:57.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:57.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:57.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:57.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:58.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:58.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:58.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:58.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:58.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:58.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:59.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:57:59.700+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:57:59.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:57:59.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:57:59.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:57:59.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:00.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:00.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:00.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:00.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:00.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:00.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:01.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:01.700+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:01.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:01.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:01.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:01.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:02.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:02.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:02.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:02.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:02.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:02.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:03.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:03.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:03.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:03.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:03.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:03.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:04.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:04.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:04.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:04.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:04.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:04.800+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:05.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:05.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:05.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:05.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:05.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:05.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:06.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:06.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:06.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:06.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:06.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:06.812+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:07.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:07.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:07.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:07.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:07.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:07.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:08.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:08.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:08.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:08.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:08.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:08.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:09.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:09.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:09.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:09.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:09.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:09.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:10.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:10.700+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:10.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:10.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:10.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:10.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:11.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:11.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:11.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:11.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:11.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:11.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:12.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:12.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:12.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:12.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:12.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:12.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:13.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:13.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:13.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:13.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:13.904 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:13.900+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:14.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:14.704+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:14.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:14.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:14.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:14.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:15.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:15.704+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:15.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:15.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:15.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:15.896+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:16.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:16.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:16.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:16.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:16.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:16.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:17.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:17.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:17.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:17.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:17.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:17.864+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:18.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:18.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:18.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:18.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:18.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:18.868+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:19.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:19.624+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:19.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:19.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:19.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:19.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:20.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:20.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:20.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:20.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:20.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:20.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:21.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:21.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:21.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:21.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:21.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:21.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:22.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:22.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:22.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:22.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:22.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:22.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:23.701 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:23.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:23.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:23.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:23.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:23.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:24.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:24.656+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:24.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:24.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:25.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:25.008+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:25.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:25.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:25.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:25.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:26.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:25.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:26.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:26.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:26.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:26.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:26.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:26.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:27.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:27.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:27.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:27.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:27.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:27.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:28.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:28.739+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:28.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:28.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:28.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:28.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:29.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:29.739+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:29.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:29.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:29.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:29.867+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:30.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:30.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:30.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:30.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:30.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:30.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:31.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:31.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:31.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:31.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:31.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:31.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:32.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:32.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:32.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:32.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:32.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:32.815+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:33.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:33.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:33.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:33.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:33.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:33.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:34.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:34.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:34.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:34.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:34.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:34.851+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:35.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:35.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:35.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:35.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:35.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:35.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:36.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:36.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:36.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:36.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:36.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:36.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:37.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:37.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:37.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:37.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:37.821 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:37.815+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:38.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:38.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:38.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:38.791+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:38.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:38.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:39.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:39.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:39.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:39.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:39.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:39.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:40.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:40.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:40.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:40.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:40.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:40.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:41.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:41.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:41.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:41.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:41.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:41.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:42.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:42.727+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:42.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:42.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:42.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:42.851+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:43.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:43.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:43.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:43.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:43.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:43.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:44.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:44.739+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:44.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:44.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:44.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:44.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:45.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:45.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:45.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:45.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:45.824 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:45.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:46.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:46.707+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:46.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:46.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:46.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:46.871+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:47.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:47.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:47.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:47.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:47.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:47.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:48.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:48.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:48.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:48.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:48.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:48.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:49.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:49.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:49.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:49.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:49.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:49.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:50.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:50.655+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:50.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:50.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:50.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:50.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:51.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:51.663+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:51.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:51.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:51.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:51.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:52.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:52.671+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:52.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:52.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:52.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:52.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:53.723 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:53.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:53.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:53.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:53.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:53.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:54.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:54.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:54.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:54.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:54.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:54.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:55.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:55.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:55.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:55.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:55.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:55.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:56.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:56.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:56.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:56.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:56.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:56.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:57.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:57.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:57.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:57.819+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:57.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:57.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:58.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:58.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:58.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:58.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:58.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:58.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:59.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:58:59.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:58:59.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:58:59.775+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:58:59.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:58:59.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:00.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:00.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:00.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:00.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:00.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:00.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:01.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:01.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:01.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:01.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:01.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:01.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:02.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:02.775+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:02.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:02.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:02.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:02.803+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:03.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:03.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:03.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:03.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:03.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:03.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:04.732 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:04.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:04.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:04.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:04.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:04.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:05.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:05.711+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:05.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:05.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:05.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:05.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:06.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:06.675+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:06.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:06.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:06.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:06.791+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:07.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:07.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:07.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:07.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:07.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:07.783+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:08.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:08.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:08.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:08.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:08.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:08.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:09.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:09.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:09.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:09.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:09.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:09.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:10.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:10.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:10.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:10.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:10.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:10.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:11.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:11.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:11.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:11.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:11.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:11.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:12.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:12.663+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:12.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:12.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:12.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:12.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:13.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:13.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:13.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:13.727+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:13.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:13.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:14.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:14.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:14.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:14.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:14.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:14.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:15.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:15.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:15.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:15.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:15.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:15.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:16.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:16.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:16.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:16.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:16.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:16.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:17.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:17.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:17.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:17.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:17.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:17.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:18.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:18.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:18.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:18.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:18.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:18.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:19.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:19.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:19.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:19.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:19.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:19.814+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:20.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:20.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:20.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:20.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:20.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:20.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:21.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:21.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:21.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:21.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:21.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:21.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:22.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:22.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:22.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:22.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:22.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:22.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:23.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:23.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:23.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:23.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:23.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:23.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:24.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:24.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:24.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:24.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:24.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:24.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:25.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:25.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:25.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:25.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:25.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:25.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:26.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:26.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:26.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:26.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:26.906 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:26.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:27.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:27.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:27.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:27.794+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:27.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:27.870+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:28.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:28.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:28.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:28.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:28.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:28.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:29.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:29.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:29.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:29.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:29.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:29.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:30.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:30.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:30.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:30.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:30.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:30.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:31.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:31.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:31.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:31.798+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:31.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:31.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:32.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:32.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:32.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:32.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:32.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:32.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:33.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:33.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:33.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:33.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:33.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:33.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:34.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:34.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:34.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:34.766+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:34.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:34.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:35.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:35.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:35.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:35.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:35.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:35.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:36.728 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:36.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:36.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:36.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:36.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:36.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:37.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:37.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:37.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:37.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:37.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:37.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:38.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:38.766+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:38.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:38.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:38.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:38.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:39.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:39.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:39.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:39.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:39.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:39.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:40.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:40.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:40.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:40.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:40.830 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:40.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:41.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:41.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:41.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:41.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:41.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:41.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:42.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:42.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:42.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:42.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:42.895 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:42.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:43.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:43.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:43.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:43.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:43.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:43.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:44.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:44.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:44.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:44.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:44.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:44.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:45.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:45.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:45.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:45.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:45.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:45.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:46.683 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:46.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:46.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:46.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:46.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:46.910+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:47.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:47.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:47.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:47.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:47.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:47.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:48.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:48.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:48.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:48.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:48.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:48.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:49.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:49.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:49.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:49.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:49.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:49.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:50.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:50.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:50.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:50.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:50.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:50.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:51.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:51.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:51.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:51.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:51.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:51.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:52.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:52.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:52.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:52.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:53.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:53.030+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:53.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:53.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:53.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:53.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:54.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:54.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:54.701 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:54.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:54.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:54.894+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:54.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:54.986+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:55.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:55.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:55.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:55.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:56.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:56.006+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:56.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:56.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:56.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:56.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:56.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:56.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:57.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:57.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:57.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:57.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:58.011 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:58.006+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:58.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:58.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:58.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:58.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:58.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:58.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:59.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T17:59:59.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T17:59:59.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T17:59:59.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T17:59:59.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T17:59:59.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:00.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:00.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:00.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:00.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:00.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:00.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:01.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:01.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:01.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:01.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:01.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:01.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:02.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:02.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:02.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:02.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:02.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:02.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:03.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:03.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:03.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:03.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:04.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:04.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:04.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:04.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:04.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:04.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:05.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:05.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:05.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:05.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:05.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:05.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:06.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:06.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:06.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:06.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:06.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:06.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:07.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:07.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:07.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:07.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:07.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:07.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:08.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:08.053+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:08.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:08.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:08.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:08.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:09.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:09.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:09.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:09.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:09.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:09.881+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:09.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:09.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:10.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:10.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:10.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:10.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:10.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:10.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:11.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:11.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:11.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:11.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:12.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:12.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:12.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:12.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:12.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:12.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:13.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:12.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:13.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:13.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:13.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:13.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:13.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:13.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:14.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:14.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:14.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:14.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:15.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:15.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:15.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:15.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:15.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:15.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:16.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:16.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:16.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:16.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:16.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:16.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:17.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:17.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:17.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:17.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:17.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:17.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:18.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:18.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:18.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:18.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:18.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:18.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:19.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:19.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:19.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:19.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:19.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:19.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:20.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:20.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:20.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:20.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:20.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:20.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:21.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:21.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:21.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:21.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:21.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:21.929+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:22.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:22.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:22.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:22.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:22.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:22.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:23.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:23.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:23.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:23.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:23.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:23.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:24.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:24.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:24.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:24.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:24.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:24.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:25.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:25.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:25.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:25.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:25.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:25.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:26.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:26.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:26.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:26.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:26.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:26.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:27.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:27.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:27.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:27.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:27.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:27.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:28.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:28.097+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:28.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:28.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:28.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:28.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:29.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:29.117+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:29.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:29.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:29.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:29.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:30.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:30.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:30.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:30.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:30.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:30.885+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:31.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:31.097+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:31.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:31.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:31.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:31.861+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:32.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:32.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:32.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:32.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:32.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:32.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:33.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:33.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:33.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:33.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:33.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:33.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:34.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:34.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:34.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:34.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:34.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:34.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:35.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:35.097+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:35.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:35.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:35.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:35.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:36.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:36.081+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:36.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:36.409+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:36.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:36.857+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:37.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:37.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:37.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:37.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:37.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:37.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:38.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:38.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:38.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:38.469+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:38.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:38.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:39.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:39.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:39.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:39.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:39.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:39.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:40.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:40.017+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:40.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:40.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:40.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:40.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:41.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:41.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:41.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:41.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:41.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:41.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:42.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:42.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:42.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:42.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:42.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:42.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:43.029 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:43.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:43.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:43.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:43.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:43.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:44.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:44.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:44.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:44.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:44.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:44.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:45.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:45.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:45.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:45.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:45.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:45.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:46.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:46.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:46.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:46.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:46.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:46.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:47.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:47.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:47.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:47.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:47.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:47.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:48.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:48.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:48.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:48.652+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:48.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:48.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:49.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:49.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:49.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:49.700+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:49.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:49.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:50.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:50.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:50.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:50.740+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:50.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:50.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:51.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:51.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:51.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:51.756+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:51.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:51.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:51.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:51.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:52.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:52.780+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:52.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:52.800+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:52.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:52.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:53.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:53.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:53.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:53.828+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:53.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:53.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:54.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:54.732+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:54.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:54.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:54.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:54.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:55.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:55.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:55.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:55.768+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:55.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:55.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:56.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:56.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:56.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:56.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:56.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:56.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:57.723 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:57.720+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:57.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:57.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:57.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:57.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:58.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:58.756+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:58.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:58.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:58.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:58.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:59.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:00:59.720+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:00:59.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:00:59.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:00:59.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:00:59.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:00.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:00.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:00.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:00.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:00.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:00.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:01.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:01.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:01.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:01.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:01.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:01.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:02.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:02.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:02.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:02.824+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:02.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:02.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:03.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:03.688+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:03.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:03.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:04.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:03.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:04.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:04.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:04.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:04.900+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:05.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:05.024+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:05.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:05.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:05.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:05.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:06.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:06.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:06.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:06.648+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:06.883 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:06.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:07.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:07.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:07.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:07.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:07.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:07.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:08.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:08.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:08.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:08.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:08.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:08.864+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:08.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:08.988+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:09.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:09.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:09.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:09.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:09.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:09.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:10.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:10.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:10.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:10.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:11.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:11.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:11.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:11.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:11.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:11.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:11.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:11.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:12.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:12.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:12.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:12.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:13.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:13.000+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:13.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:13.624+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:13.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:13.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:13.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:13.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:14.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:14.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:14.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:14.920+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:15.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:15.000+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:15.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:15.692+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:15.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:15.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:16.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:16.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:16.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:16.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:16.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:16.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:17.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:17.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:17.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:17.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:17.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:17.872+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:18.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:18.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:18.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:18.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:18.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:18.884+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:19.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:19.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:19.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:19.648+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:19.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:19.860+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:20.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:20.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:20.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:20.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:20.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:20.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:21.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:21.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:21.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:21.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:21.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:21.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:22.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:22.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:22.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:22.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:22.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:22.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:23.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:23.140+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:23.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:23.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:24.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:24.008+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:24.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:24.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:24.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:24.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:25.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:25.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:25.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:25.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:25.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:25.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:26.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:26.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:26.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:26.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:26.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:26.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:27.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:27.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:27.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:27.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:27.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:27.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:28.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:28.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:28.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:28.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:28.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:28.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:29.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:29.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:29.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:29.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:29.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:29.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:30.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:30.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:30.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:30.124+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:30.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:30.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:31.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:31.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:31.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:31.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:31.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:31.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:32.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:32.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:32.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:32.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:32.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:32.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:33.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:32.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:33.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:33.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:33.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:33.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:33.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:33.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:34.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:34.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:34.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:34.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:34.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:34.967+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:35.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:35.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:35.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:35.671+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:36.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:36.015+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:36.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:36.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:36.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:36.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:37.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:37.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:37.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:37.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:37.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:37.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:38.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:38.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:38.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:38.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:38.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:38.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:39.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:39.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:39.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:39.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:39.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:39.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:40.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:40.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:40.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:40.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:40.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:40.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:41.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:41.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:41.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:41.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:41.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:41.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:42.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:42.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:42.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:42.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:42.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:42.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:43.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:43.015+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:43.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:43.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:43.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:43.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:44.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:44.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:44.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:44.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:44.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:44.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:45.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:45.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:45.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:45.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:45.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:45.735+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:46.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:46.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:46.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:46.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:46.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:46.699+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:47.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:47.035+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:47.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:47.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:47.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:47.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:48.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:48.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:48.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:48.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:48.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:48.671+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:49.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:48.995+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:49.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:49.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:49.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:49.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:49.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:49.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:50.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:50.115+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:50.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:50.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:50.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:50.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:51.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:51.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:51.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:51.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:51.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:51.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:52.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:52.123+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:52.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:52.663+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:52.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:52.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:53.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:53.083+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:53.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:53.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:53.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:53.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:54.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:54.095+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:54.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:54.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:54.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:54.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:55.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:55.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:55.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:55.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:55.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:55.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:56.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:56.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:56.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:56.671+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:56.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:56.971+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:57.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:57.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:57.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:57.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:57.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:57.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:58.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:58.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:58.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:58.695+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:58.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:58.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:59.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:01:59.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:01:59.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:01:59.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:01:59.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:01:59.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:00.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:00.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:00.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:00.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:00.959 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:00.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:01.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:01.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:01.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:01.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:02.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:02.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:02.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:02.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:02.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:02.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:03.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:03.047+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:03.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:03.239+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:03.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:03.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:04.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:04.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:04.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:04.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:04.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:04.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:05.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:05.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:05.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:05.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:05.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:05.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:05.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:05.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:06.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:06.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:06.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:06.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:06.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:06.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:07.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:07.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:07.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:07.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:07.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:07.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:08.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:08.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:08.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:08.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:08.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:08.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:09.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:09.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:09.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:09.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:09.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:09.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:10.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:10.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:10.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:10.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:10.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:10.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:11.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:11.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:11.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:11.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:11.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:11.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:12.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:12.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:12.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:12.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:12.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:12.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:13.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:13.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:13.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:13.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:13.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:13.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:14.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:14.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:14.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:14.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:14.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:14.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:15.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:15.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:15.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:15.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:15.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:15.907+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:16.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:16.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:16.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:16.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:16.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:16.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:17.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:17.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:17.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:17.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:17.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:17.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:18.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:18.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:18.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:18.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:18.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:18.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:19.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:19.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:19.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:19.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:19.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:19.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:20.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:20.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:20.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:20.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:20.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:20.899+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:21.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:21.483+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:21.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:21.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:21.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:21.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:22.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:22.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:22.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:22.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:22.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:22.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:23.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:23.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:23.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:23.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:23.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:23.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:24.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:24.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:24.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:24.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:24.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:24.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:25.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:25.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:25.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:25.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:25.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:25.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:26.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:26.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:26.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:26.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:26.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:26.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:27.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:27.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:27.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:27.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:27.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:27.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:28.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:28.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:28.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:28.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:28.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:28.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:29.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:29.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:29.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:29.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:29.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:29.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:30.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:30.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:30.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:30.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:30.830 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:30.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:31.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:31.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:31.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:31.542+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:31.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:31.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:32.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:32.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:32.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:32.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:32.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:32.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:33.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:33.562+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:33.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:33.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:33.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:33.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:34.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:34.566+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:34.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:34.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:34.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:34.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:35.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:35.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:35.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:35.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:35.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:35.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:36.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:36.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:36.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:36.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:36.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:36.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:37.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:37.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:37.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:37.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:37.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:37.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:38.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:38.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:38.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:38.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:38.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:38.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:39.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:39.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:39.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:39.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:39.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:39.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:40.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:40.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:40.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:40.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:40.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:40.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:41.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:41.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:41.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:41.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:41.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:41.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:42.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:42.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:42.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:42.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:42.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:42.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:43.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:43.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:43.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:43.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:43.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:43.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:44.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:44.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:44.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:44.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:44.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:44.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:45.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:45.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:45.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:45.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:45.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:45.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:46.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:46.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:46.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:46.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:46.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:46.934+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:47.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:47.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:47.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:47.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:47.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:47.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:48.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:48.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:48.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:48.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:48.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:48.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:49.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:49.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:49.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:49.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:49.974 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:49.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:50.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:50.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:50.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:50.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:50.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:50.990+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:51.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:51.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:51.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:51.814+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:51.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:51.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:52.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:52.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:52.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:52.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:52.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:52.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:53.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:53.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:53.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:53.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:53.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:53.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:54.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:54.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:54.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:54.826+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:54.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:54.974+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:55.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:55.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:55.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:55.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:55.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:55.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:56.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:56.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:56.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:56.902+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:57.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:56.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:57.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:57.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:57.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:57.910+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:58.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:58.006+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:58.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:58.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:58.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:58.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:58.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:58.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:59.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:02:59.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:02:59.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:02:59.834+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:02:59.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:02:59.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:00.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:00.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:00.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:00.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:00.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:00.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:01.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:01.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:01.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:01.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:01.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:01.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:02.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:02.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:02.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:02.826+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:03.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:03.034+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:03.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:03.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:03.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:03.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:04.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:04.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:04.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:04.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:04.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:04.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:05.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:05.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:05.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:05.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:05.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:05.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:06.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:06.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:06.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:06.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:06.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:06.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:07.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:07.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:07.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:07.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:07.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:07.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:08.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:08.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:08.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:08.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:08.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:08.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:09.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:09.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:09.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:09.657+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:09.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:09.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:10.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:10.049+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:10.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:10.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:10.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:10.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:11.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:11.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:11.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:11.677+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:11.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:11.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:12.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:12.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:12.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:12.657+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:12.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:12.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:13.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:13.033+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:13.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:13.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:13.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:13.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:14.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:14.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:14.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:14.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:14.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:14.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:14.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:14.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:15.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:15.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:15.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:15.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:15.949 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:15.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:16.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:16.741+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:16.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:16.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:16.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:16.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:17.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:17.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:17.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:17.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:17.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:17.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:18.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:18.745+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:18.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:18.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:18.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:18.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:19.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:19.745+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:19.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:19.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:19.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:19.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:20.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:20.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:20.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:20.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:20.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:20.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:21.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:21.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:21.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:21.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:21.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:21.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:22.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:22.721+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:22.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:22.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:22.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:22.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:23.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:23.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:23.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:23.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:23.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:23.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:24.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:24.721+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:24.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:24.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:24.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:24.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:25.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:25.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:25.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:25.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:25.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:25.929+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:26.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:26.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:26.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:26.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:26.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:26.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:27.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:27.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:27.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:27.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:27.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:27.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:28.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:28.693+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:28.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:28.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:29.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:29.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:29.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:29.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:29.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:29.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:30.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:30.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:30.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:30.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:30.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:30.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:31.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:31.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:31.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:31.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:31.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:31.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:32.051 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:32.049+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:32.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:32.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:32.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:32.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:33.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:33.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:33.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:33.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:33.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:33.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:34.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:34.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:34.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:34.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:34.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:34.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:35.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:35.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:35.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:35.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:35.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:35.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:36.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:36.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:36.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:36.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:36.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:36.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:37.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:37.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:37.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:37.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:37.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:37.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:38.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:38.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:38.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:38.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:38.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:38.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:39.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:39.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:39.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:39.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:39.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:39.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:40.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:40.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:40.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:40.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:40.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:40.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:41.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:41.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:41.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:41.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:41.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:41.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:42.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:42.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:42.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:42.693+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:42.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:42.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:43.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:43.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:43.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:43.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:43.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:43.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:44.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:44.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:44.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:44.741+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:44.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:44.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:45.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:45.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:45.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:45.721+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:45.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:45.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:46.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:46.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:46.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:46.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:46.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:46.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:47.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:47.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:47.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:47.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:47.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:47.893+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:48.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:48.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:48.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:48.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:48.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:48.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:49.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:49.377+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:49.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:49.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:49.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:49.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:50.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:50.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:50.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:50.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:50.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:50.893+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:51.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:51.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:51.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:51.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:51.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:51.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:52.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:52.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:52.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:52.725+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:52.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:52.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:53.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:53.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:53.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:53.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:53.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:53.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:54.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:54.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:54.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:54.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:54.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:54.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:55.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:55.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:55.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:55.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:55.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:55.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:56.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:56.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:56.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:56.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:56.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:56.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:57.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:57.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:57.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:57.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:57.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:57.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:58.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:58.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:58.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:58.680+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:58.921 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:58.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:59.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:03:59.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:03:59.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:03:59.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:03:59.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:03:59.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:00.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:00.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:00.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:00.616+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:00.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:00.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:01.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:01.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:01.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:01.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:01.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:01.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:02.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:02.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:02.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:02.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:02.945 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:02.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:03.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:03.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:03.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:03.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:03.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:03.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:04.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:04.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:04.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:04.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:04.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:04.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:05.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:05.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:05.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:05.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:05.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:05.880+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:06.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:06.324+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:06.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:06.504+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:06.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:06.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:07.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:07.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:07.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:07.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:07.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:07.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:08.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:08.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:08.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:08.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:08.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:08.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:09.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:09.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:09.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:09.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:09.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:09.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:10.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:10.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:10.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:10.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:10.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:10.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:11.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:11.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:11.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:11.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:12.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:12.020+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:12.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:12.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:12.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:12.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:13.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:13.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:13.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:13.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:13.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:13.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:14.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:14.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:14.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:14.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:14.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:14.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:14.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:14.988+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:15.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:15.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:15.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:15.320+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:15.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:15.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:16.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:16.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:16.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:16.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:16.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:16.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:17.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:17.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:17.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:17.312+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:17.921 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:17.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:18.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:18.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:18.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:18.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:18.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:18.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:19.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:19.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:19.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:19.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:19.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:19.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:20.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:20.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:20.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:20.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:20.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:20.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:21.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:21.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:21.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:21.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:21.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:21.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:22.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:22.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:22.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:22.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:22.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:22.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:23.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:23.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:23.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:23.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:23.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:23.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:24.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:24.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:24.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:24.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:24.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:24.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:25.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:25.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:25.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:25.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:25.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:25.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:26.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:26.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:26.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:26.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:26.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:26.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:27.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:27.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:27.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:27.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:27.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:27.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:28.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:28.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:28.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:28.340+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:28.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:28.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:29.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:29.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:29.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:29.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:29.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:29.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:30.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:30.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:30.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:30.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:30.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:30.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:31.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:31.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:31.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:31.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:31.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:31.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:32.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:32.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:32.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:32.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:32.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:32.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:33.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:33.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:33.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:33.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:33.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:33.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:34.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:34.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:34.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:34.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:34.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:34.976+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:35.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:35.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:35.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:35.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:35.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:35.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:36.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:36.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:36.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:36.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:37.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:37.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:37.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:37.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:37.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:37.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:38.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:38.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:38.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:38.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:38.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:38.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:39.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:39.052+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:39.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:39.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:39.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:39.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:40.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:40.036+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:40.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:40.244+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:40.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:40.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:41.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:41.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:41.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:41.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:41.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:41.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:42.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:42.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:42.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:42.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:42.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:42.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:43.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:43.039+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:43.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:43.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:43.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:43.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:43.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:43.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:44.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:44.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:44.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:44.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:44.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:44.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:45.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:45.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:45.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:45.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:45.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:45.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:46.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:46.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:46.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:46.387+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:46.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:46.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:47.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:47.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:47.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:47.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:47.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:47.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:48.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:48.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:48.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:48.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:48.909 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:48.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:49.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:49.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:49.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:49.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:49.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:49.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:50.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:50.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:50.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:50.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:50.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:50.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:51.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:51.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:51.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:51.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:52.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:52.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:52.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:52.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:52.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:52.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:52.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:52.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:53.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:53.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:53.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:53.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:54.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:54.015+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:54.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:54.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:54.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:54.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:55.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:55.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:56.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:55.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:56.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:55.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:56.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:56.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:56.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:56.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:56.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:56.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:57.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:57.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:57.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:57.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:57.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:57.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:58.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:58.063+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:58.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:58.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:58.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:58.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:59.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:04:59.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:04:59.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:04:59.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:04:59.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:04:59.423+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:00.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:00.035+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:00.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:00.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:00.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:00.419+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:01.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:01.051+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:01.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:01.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:01.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:01.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:02.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:02.075+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:02.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:02.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:02.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:02.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:03.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:03.111+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:03.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:03.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:03.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:03.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:04.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:04.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:04.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:04.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:04.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:04.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:05.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:05.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:05.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:05.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:05.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:05.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:06.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:06.151+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:06.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:06.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:06.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:06.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:07.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:07.151+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:07.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:07.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:07.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:07.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:08.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:08.107+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:08.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:08.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:08.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:08.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:09.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:09.111+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:09.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:09.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:09.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:09.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:10.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:10.163+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:10.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:10.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:10.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:10.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:11.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:11.167+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:11.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:11.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:11.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:11.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:12.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:12.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:12.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:12.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:12.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:12.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:13.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:13.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:13.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:13.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:13.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:13.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:14.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:14.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:14.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:14.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:14.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:14.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:15.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:15.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:15.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:15.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:15.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:15.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:16.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:16.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:16.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:16.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:16.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:16.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:17.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:17.235+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:17.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:17.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:17.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:17.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:18.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:18.247+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:18.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:18.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:18.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:18.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:19.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:19.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:19.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:19.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:19.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:19.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:20.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:20.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:20.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:20.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:20.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:20.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:21.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:21.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:21.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:21.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:21.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:21.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:22.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:22.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:22.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:22.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:22.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:22.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:23.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:23.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:23.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:23.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:23.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:23.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:24.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:24.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:24.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:24.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:24.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:24.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:25.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:25.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:25.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:25.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:25.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:25.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:26.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:26.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:26.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:26.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:26.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:26.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:27.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:27.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:27.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:27.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:27.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:27.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:28.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:28.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:28.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:28.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:28.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:28.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:29.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:29.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:29.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:29.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:29.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:29.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:30.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:30.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:30.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:30.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:30.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:30.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:31.248 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:31.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:31.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:31.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:31.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:31.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:32.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:32.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:32.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:32.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:32.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:32.442+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:33.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:33.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:33.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:33.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:33.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:33.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:34.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:34.286+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:34.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:34.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:34.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:34.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:35.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:35.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:35.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:35.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:35.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:35.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:36.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:36.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:36.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:36.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:36.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:36.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:37.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:37.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:37.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:37.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:37.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:37.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:38.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:38.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:38.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:38.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:38.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:38.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:39.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:39.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:39.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:39.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:39.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:39.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:40.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:40.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:40.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:40.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:40.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:40.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:41.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:41.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:41.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:41.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:41.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:41.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:42.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:42.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:42.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:42.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:42.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:42.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:43.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:43.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:43.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:43.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:43.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:43.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:44.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:44.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:44.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:44.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:44.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:44.606+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:45.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:45.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:45.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:45.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:45.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:45.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:46.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:46.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:46.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:46.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:46.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:46.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:47.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:47.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:47.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:47.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:47.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:47.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:48.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:48.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:48.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:48.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:48.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:48.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:49.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:49.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:49.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:49.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:49.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:49.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:50.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:50.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:50.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:50.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:50.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:50.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:51.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:51.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:51.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:51.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:51.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:51.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:52.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:52.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:52.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:52.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:52.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:52.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:53.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:53.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:53.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:53.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:53.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:53.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:54.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:54.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:54.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:54.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:54.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:54.622+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:55.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:55.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:55.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:55.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:55.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:55.626+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:56.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:56.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:56.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:56.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:56.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:56.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:57.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:57.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:57.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:57.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:57.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:57.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:58.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:58.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:58.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:58.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:58.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:58.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:59.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:05:59.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:05:59.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:05:59.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:05:59.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:05:59.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:00.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:00.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:00.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:00.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:00.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:00.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:01.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:01.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:01.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:01.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:01.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:01.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:02.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:02.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:02.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:02.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:02.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:02.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:03.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:03.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:03.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:03.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:03.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:03.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:04.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:04.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:04.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:04.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:04.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:04.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:05.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:05.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:05.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:05.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:05.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:05.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:06.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:06.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:06.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:06.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:06.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:06.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:07.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:07.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:07.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:07.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:07.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:07.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:08.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:08.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:08.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:08.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:08.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:08.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:09.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:09.006+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:09.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:09.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:09.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:09.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:10.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:09.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:10.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:10.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:10.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:10.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:10.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:10.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:11.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:11.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:11.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:11.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:12.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:12.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:12.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:12.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:12.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:12.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:13.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:13.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:13.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:13.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:13.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:13.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:14.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:14.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:14.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:14.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:14.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:14.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:15.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:15.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:15.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:15.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:15.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:15.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:15.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:15.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:16.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:16.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:16.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:16.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:17.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:17.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:17.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:17.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:17.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:17.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:18.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:18.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:18.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:18.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:18.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:18.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:19.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:19.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:19.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:19.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:19.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:19.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:20.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:20.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:20.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:20.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:20.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:20.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:21.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:21.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:21.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:21.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:21.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:21.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:22.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:22.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:22.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:22.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:22.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:22.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:23.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:23.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:23.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:23.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:23.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:23.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:24.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:24.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:24.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:24.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:24.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:24.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:25.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:25.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:25.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:25.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:25.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:25.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:26.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:26.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:26.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:26.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:26.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:26.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:27.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:27.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:27.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:27.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:27.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:27.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:28.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:28.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:28.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:28.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:28.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:28.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:29.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:29.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:29.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:29.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:29.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:29.817+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:30.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:30.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:30.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:30.481+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:30.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:30.865+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:31.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:31.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:31.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:31.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:31.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:31.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:32.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:32.149+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:32.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:32.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:32.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:32.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:33.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:33.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:33.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:33.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:33.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:33.885+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:34.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:34.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:34.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:34.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:34.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:34.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:35.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:35.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:35.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:35.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:35.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:35.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:36.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:36.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:36.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:36.557+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:36.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:36.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:37.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:37.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:37.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:37.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:37.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:37.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:38.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:38.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:38.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:38.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:38.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:38.901+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:39.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:39.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:39.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:39.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:39.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:39.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:40.059 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:40.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:40.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:40.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:40.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:40.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:41.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:41.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:41.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:41.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:41.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:41.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:42.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:42.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:42.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:42.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:42.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:42.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:43.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:43.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:43.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:43.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:43.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:43.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:44.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:44.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:44.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:44.625+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:44.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:44.929+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:45.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:45.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:45.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:45.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:45.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:45.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:46.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:46.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:46.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:46.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:46.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:46.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:47.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:47.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:47.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:47.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:47.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:47.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:48.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:48.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:48.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:48.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:48.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:48.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:49.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:49.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:49.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:49.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:49.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:49.885+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:50.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:50.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:50.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:50.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:50.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:50.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:51.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:51.089+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:51.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:51.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:51.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:51.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:52.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:52.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:52.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:52.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:52.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:52.901+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:53.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:53.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:53.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:53.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:53.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:53.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:54.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:54.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:54.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:54.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:54.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:54.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:55.104 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:55.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:55.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:55.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:55.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:55.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:56.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:56.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:56.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:56.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:56.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:56.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:57.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:57.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:57.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:57.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:57.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:57.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:58.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:58.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:58.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:58.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:58.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:58.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:59.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:06:59.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:06:59.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:06:59.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:06:59.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:06:59.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:00.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:00.097+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:00.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:00.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:01.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:00.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:01.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:01.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:01.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:01.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:01.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:01.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:02.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:02.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:02.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:02.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:02.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:02.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:03.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:03.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:03.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:03.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:03.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:03.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:04.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:04.044+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:04.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:04.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:05.019 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:05.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:05.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:05.048+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:05.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:05.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:05.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:05.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:06.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:06.088+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:06.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:06.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:06.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:06.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:07.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:07.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:07.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:07.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:07.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:07.972+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:08.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:08.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:08.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:08.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:08.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:08.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:09.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:09.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:09.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:09.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:09.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:09.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:10.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:10.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:10.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:10.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:10.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:10.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:11.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:11.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:11.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:11.944+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:12.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:12.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:12.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:12.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:12.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:12.992+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:13.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:13.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:13.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:13.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:13.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:13.992+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:14.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:14.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:14.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:14.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:15.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:15.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:15.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:15.032+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:15.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:15.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:15.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:15.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:16.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:16.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:16.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:16.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:16.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:16.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:17.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:17.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:17.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:17.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:17.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:17.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:18.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:18.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:18.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:18.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:18.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:18.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:18.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:18.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:19.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:19.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:19.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:19.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:20.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:20.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:20.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:20.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:20.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:20.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:21.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:21.012+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:21.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:21.148+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:21.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:21.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:21.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:21.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:22.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:22.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:22.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:22.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:22.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:22.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:23.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:23.204+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:23.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:23.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:23.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:23.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:24.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:24.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:24.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:24.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:24.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:24.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:25.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:25.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:25.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:25.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:25.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:25.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:26.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:26.200+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:26.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:26.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:26.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:26.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:27.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:27.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:27.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:27.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:27.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:27.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:28.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:28.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:28.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:28.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:28.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:28.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:29.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:29.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:29.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:29.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:29.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:29.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:30.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:30.192+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:30.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:30.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:30.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:30.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:31.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:31.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:31.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:31.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:32.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:32.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:32.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:32.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:32.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:32.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:33.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:33.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:33.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:33.300+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:33.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:33.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:34.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:34.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:34.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:34.300+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:34.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:34.864+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:35.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:35.048+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:35.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:35.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:35.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:35.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:36.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:36.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:36.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:36.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:36.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:36.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:36.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:36.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:37.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:37.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:37.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:37.868+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:37.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:37.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:38.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:38.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:38.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:38.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:38.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:38.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:39.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:39.344+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:39.830 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:39.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:39.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:39.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:40.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:40.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:40.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:40.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:40.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:40.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:41.317 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:41.312+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:41.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:41.820+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:41.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:41.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:42.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:42.292+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:42.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:42.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:42.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:42.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:43.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:43.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:43.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:43.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:43.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:43.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:44.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:44.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:44.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:44.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:44.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:44.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:45.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:45.312+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:45.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:45.824+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:45.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:45.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:46.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:46.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:46.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:46.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:46.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:46.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:47.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:47.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:47.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:47.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:48.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:47.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:48.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:48.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:48.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:48.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:49.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:49.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:49.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:49.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:49.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:49.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:49.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:49.991+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:50.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:50.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:50.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:50.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:51.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:51.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:51.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:51.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:51.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:51.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:52.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:52.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:52.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:52.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:52.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:52.807+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:53.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:52.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:53.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:53.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:53.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:53.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:53.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:53.967+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:54.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:54.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:54.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:54.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:54.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:54.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:55.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:55.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:55.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:55.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:55.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:55.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:56.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:56.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:56.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:56.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:56.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:56.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:57.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:57.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:57.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:57.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:57.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:57.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:58.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:58.395+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:58.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:58.675+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:58.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:58.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:07:59.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:07:59.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:59.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:07:59.715+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:07:59.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:07:59.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:00.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:00.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:00.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:00.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:00.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:00.911+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:01.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:01.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:01.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:01.783+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:01.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:01.879+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:02.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:02.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:02.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:02.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:02.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:02.863+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:03.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:03.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:03.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:03.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:03.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:03.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:04.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:04.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:04.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:04.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:04.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:04.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:05.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:05.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:05.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:05.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:05.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:05.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:06.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:06.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:06.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:06.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:06.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:06.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:07.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:07.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:07.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:07.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:07.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:07.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:08.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:08.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:08.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:08.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:08.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:08.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:09.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:09.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:09.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:09.711+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:09.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:09.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:10.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:10.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:10.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:10.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:10.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:10.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:11.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:11.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:11.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:11.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:11.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:11.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:12.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:12.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:12.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:12.635+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:12.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:12.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:13.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:13.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:13.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:13.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:13.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:13.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:14.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:14.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:14.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:14.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:14.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:14.927+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:15.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:15.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:15.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:15.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:15.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:15.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:16.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:16.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:16.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:16.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:16.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:16.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:17.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:17.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:17.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:17.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:17.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:17.883+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:18.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:18.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:18.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:18.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:18.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:18.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:19.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:19.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:19.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:19.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:19.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:19.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:20.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:20.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:20.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:20.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:20.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:20.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:21.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:21.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:21.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:21.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:21.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:21.839+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:22.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:22.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:22.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:22.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:22.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:22.819+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:23.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:23.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:23.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:23.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:23.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:23.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:24.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:24.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:24.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:24.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:24.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:24.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:25.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:25.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:25.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:25.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:25.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:25.739+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:26.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:26.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:26.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:26.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:26.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:26.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:27.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:27.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:27.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:27.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:27.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:27.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:28.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:28.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:28.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:28.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:28.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:28.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:29.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:29.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:29.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:29.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:29.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:29.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:30.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:30.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:30.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:30.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:30.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:30.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:31.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:31.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:31.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:31.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:31.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:31.827+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:32.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:32.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:32.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:32.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:32.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:32.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:33.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:33.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:33.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:33.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:33.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:33.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:34.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:34.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:34.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:34.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:34.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:34.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:35.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:35.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:35.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:35.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:35.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:35.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:36.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:36.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:36.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:36.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:36.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:36.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:37.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:37.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:37.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:37.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:37.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:37.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:38.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:38.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:38.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:38.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:38.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:38.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:39.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:39.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:39.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:39.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:39.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:39.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:40.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:40.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:40.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:40.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:40.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:40.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:41.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:41.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:41.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:41.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:41.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:41.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:42.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:42.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:42.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:42.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:42.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:42.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:43.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:43.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:43.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:43.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:43.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:43.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:44.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:44.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:44.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:44.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:44.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:44.986+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:45.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:45.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:45.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:45.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:45.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:45.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:46.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:46.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:46.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:46.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:46.918 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:46.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:47.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:47.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:47.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:47.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:47.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:47.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:48.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:48.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:48.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:48.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:48.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:48.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:49.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:49.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:49.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:49.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:49.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:49.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:50.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:50.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:50.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:50.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:50.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:50.846+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:51.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:51.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:51.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:51.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:51.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:51.810+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:52.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:52.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:52.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:52.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:52.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:52.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:53.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:53.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:53.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:53.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:53.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:53.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:54.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:54.394+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:54.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:54.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:54.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:54.766+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:55.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:55.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:55.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:55.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:55.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:55.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:56.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:56.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:56.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:56.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:56.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:56.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:57.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:57.470+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:57.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:57.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:57.707 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:57.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:58.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:58.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:58.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:58.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:58.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:58.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:08:59.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:08:59.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:59.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:08:59.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:08:59.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:08:59.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:00.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:00.386+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:00.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:00.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:00.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:00.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:01.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:01.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:01.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:01.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:01.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:01.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:02.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:02.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:02.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:02.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:02.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:02.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:03.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:03.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:03.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:03.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:03.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:03.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:04.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:04.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:04.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:04.570+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:04.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:04.750+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:05.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:05.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:05.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:05.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:05.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:05.798+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:06.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:06.346+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:06.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:06.622+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:06.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:06.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:07.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:07.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:07.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:07.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:07.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:07.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:08.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:08.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:08.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:08.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:08.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:08.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:09.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:09.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:09.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:09.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:09.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:09.878+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:10.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:10.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:10.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:10.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:10.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:10.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:11.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:11.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:11.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:11.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:11.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:11.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:12.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:12.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:12.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:12.630+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:12.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:12.846+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:13.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:13.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:13.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:13.622+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:13.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:13.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:14.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:14.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:14.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:14.642+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:14.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:14.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:15.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:15.310+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:15.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:15.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:15.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:15.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:16.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:16.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:16.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:16.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:16.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:16.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:17.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:17.286+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:17.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:17.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:17.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:17.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:18.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:18.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:18.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:18.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:18.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:18.810+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:19.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:19.346+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:19.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:19.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:19.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:19.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:20.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:20.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:20.537 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:20.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:20.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:20.785+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:21.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:21.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:21.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:21.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:21.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:21.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:22.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:22.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:22.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:22.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:22.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:22.769+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:23.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:23.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:23.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:23.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:23.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:23.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:24.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:24.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:24.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:24.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:24.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:24.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:25.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:25.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:25.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:25.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:25.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:25.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:26.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:26.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:26.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:26.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:26.877 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:26.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:27.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:27.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:27.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:27.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:27.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:27.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:28.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:28.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:28.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:28.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:28.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:28.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:29.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:29.449+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:29.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:29.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:29.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:29.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:30.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:30.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:30.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:30.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:30.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:30.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:31.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:31.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:31.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:31.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:31.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:31.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:32.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:32.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:32.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:32.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:32.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:32.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:33.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:33.481+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:33.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:33.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:33.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:33.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:34.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:34.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:34.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:34.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:34.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:34.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:35.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:35.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:35.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:35.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:35.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:35.945+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:36.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:36.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:36.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:36.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:36.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:36.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:37.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:37.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:37.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:37.553+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:37.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:37.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:38.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:38.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:38.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:38.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:38.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:38.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:39.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:39.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:39.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:39.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:40.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:39.997+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:40.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:40.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:40.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:40.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:40.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:40.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:41.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:41.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:41.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:41.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:41.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:41.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:42.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:42.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:42.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:42.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:42.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:42.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:43.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:43.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:43.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:43.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:43.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:43.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:44.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:44.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:44.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:44.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:44.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:44.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:45.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:45.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:45.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:45.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:45.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:45.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:46.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:46.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:46.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:46.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:46.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:46.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:47.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:47.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:47.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:47.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:48.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:48.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:48.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:48.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:48.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:48.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:49.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:49.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:49.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:49.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:49.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:49.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:50.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:50.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:50.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:50.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:50.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:50.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:51.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:51.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:51.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:51.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:51.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:51.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:52.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:52.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:52.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:52.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:52.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:52.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:53.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:53.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:53.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:53.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:53.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:53.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:54.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:54.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:54.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:54.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:54.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:54.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:55.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:55.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:55.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:55.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:55.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:55.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:56.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:56.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:56.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:56.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:56.537 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:56.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:57.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:57.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:57.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:57.509+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:57.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:57.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:58.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:58.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:58.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:58.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:58.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:58.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:59.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:09:59.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:09:59.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:09:59.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:09:59.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:09:59.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:00.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:00.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:00.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:00.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:00.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:00.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:01.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:01.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:01.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:01.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:01.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:01.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:02.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:02.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:02.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:02.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:02.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:02.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:03.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:03.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:03.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:03.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:03.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:03.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:04.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:04.109+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:04.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:04.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:04.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:04.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:05.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:05.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:05.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:05.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:05.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:05.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:06.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:06.109+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:06.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:06.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:06.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:06.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:07.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:07.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:07.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:07.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:07.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:07.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:08.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:08.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:08.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:08.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:08.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:08.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:09.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:09.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:09.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:09.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:09.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:09.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:10.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:10.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:10.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:10.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:10.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:10.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:11.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:11.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:11.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:11.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:11.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:11.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:12.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:12.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:12.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:12.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:12.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:12.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:13.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:13.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:13.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:13.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:13.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:13.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:14.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:14.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:14.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:14.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:14.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:14.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:15.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:15.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:15.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:15.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:15.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:15.516+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:16.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:16.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:16.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:16.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:16.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:16.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:17.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:17.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:17.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:17.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:17.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:17.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:18.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:18.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:18.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:18.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:18.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:18.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:19.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:19.156+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:19.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:19.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:19.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:19.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:20.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:20.144+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:20.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:20.344+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:20.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:20.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:21.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:21.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:21.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:21.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:21.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:21.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:22.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:22.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:22.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:22.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:22.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:22.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:23.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:23.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:23.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:23.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:23.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:23.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:24.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:24.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:24.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:24.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:24.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:24.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:25.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:25.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:25.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:25.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:25.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:25.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:26.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:26.108+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:26.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:26.336+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:26.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:26.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:27.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:27.128+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:27.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:27.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:27.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:27.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:28.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:28.088+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:28.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:28.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:28.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:28.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:29.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:29.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:29.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:29.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:29.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:29.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:30.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:30.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:30.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:30.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:30.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:30.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:31.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:31.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:31.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:31.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:31.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:31.320+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:32.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:32.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:32.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:32.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:32.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:32.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:33.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:33.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:33.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:33.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:33.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:33.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:34.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:34.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:34.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:34.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:34.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:34.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:35.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:35.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:35.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:35.340+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:35.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:35.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:36.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:36.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:36.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:36.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:36.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:36.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:37.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:37.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:37.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:37.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:37.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:37.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:38.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:38.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:38.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:38.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:38.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:38.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:39.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:39.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:39.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:39.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:39.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:39.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:40.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:40.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:40.364 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:40.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:40.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:40.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:41.223 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:41.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:41.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:41.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:41.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:41.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:42.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:42.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:42.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:42.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:42.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:42.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:43.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:43.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:43.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:43.300+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:43.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:43.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:44.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:44.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:44.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:44.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:44.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:44.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:45.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:45.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:45.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:45.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:45.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:45.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:46.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:46.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:46.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:46.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:46.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:46.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:47.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:47.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:47.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:47.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:47.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:47.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:48.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:48.144+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:48.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:48.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:48.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:48.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:49.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:49.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:49.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:49.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:49.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:49.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:50.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:50.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:50.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:50.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:50.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:50.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:51.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:51.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:51.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:51.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:51.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:51.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:52.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:52.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:52.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:52.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:52.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:52.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:53.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:53.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:53.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:53.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:53.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:53.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:54.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:54.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:54.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:54.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:54.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:54.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:55.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:55.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:55.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:55.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:55.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:55.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:56.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:56.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:56.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:56.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:56.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:56.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:57.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:57.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:57.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:57.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:57.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:57.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:58.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:58.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:58.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:58.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:58.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:58.439+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:59.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:10:59.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:10:59.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:10:59.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:10:59.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:10:59.467+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:00.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:00.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:00.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:00.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:00.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:00.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:01.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:01.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:01.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:01.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:01.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:01.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:02.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:02.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:02.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:02.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:02.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:02.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:03.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:03.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:03.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:03.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:03.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:03.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:04.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:04.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:04.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:04.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:04.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:04.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:05.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:05.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:05.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:05.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:05.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:05.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:06.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:06.175+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:06.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:06.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:06.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:06.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:07.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:07.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:07.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:07.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:07.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:07.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:08.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:08.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:08.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:08.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:08.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:08.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:09.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:09.167+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:09.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:09.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:09.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:09.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:10.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:10.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:10.371 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:10.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:10.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:10.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:11.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:11.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:11.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:11.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:11.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:11.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:12.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:12.107+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:12.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:12.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:12.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:12.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:13.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:13.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:13.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:13.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:13.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:13.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:14.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:14.127+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:14.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:14.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:14.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:14.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:15.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:15.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:15.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:15.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:15.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:15.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:16.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:16.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:16.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:16.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:16.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:16.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:17.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:17.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:17.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:17.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:17.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:17.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:18.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:18.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:18.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:18.331+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:18.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:18.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:19.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:19.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:19.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:19.303+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:19.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:19.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:20.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:20.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:20.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:20.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:20.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:20.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:21.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:21.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:21.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:21.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:21.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:21.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:22.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:22.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:22.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:22.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:22.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:22.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:23.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:23.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:23.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:23.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:23.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:23.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:24.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:24.175+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:24.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:24.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:24.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:24.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:25.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:25.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:25.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:25.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:25.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:25.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:26.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:26.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:26.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:26.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:26.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:26.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:27.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:27.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:27.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:27.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:27.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:27.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:28.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:28.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:28.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:28.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:28.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:28.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:29.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:29.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:29.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:29.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:29.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:29.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:30.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:30.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:30.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:30.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:30.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:30.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:31.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:31.167+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:31.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:31.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:31.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:31.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:32.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:32.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:32.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:32.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:32.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:32.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:33.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:33.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:33.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:33.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:33.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:33.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:34.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:34.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:34.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:34.371+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:34.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:34.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:35.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:35.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:35.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:35.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:35.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:35.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:36.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:36.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:36.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:36.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:36.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:36.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:37.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:37.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:37.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:37.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:37.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:37.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:38.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:38.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:38.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:38.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:38.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:38.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:39.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:39.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:39.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:39.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:39.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:39.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:40.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:40.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:40.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:40.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:40.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:40.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:41.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:41.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:41.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:41.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:41.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:41.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:42.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:42.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:42.359 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:42.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:42.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:42.442+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:43.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:43.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:43.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:43.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:43.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:43.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:44.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:44.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:44.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:44.286+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:44.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:44.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:45.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:45.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:45.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:45.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:45.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:45.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:46.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:46.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:46.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:46.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:46.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:46.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:47.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:47.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:47.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:47.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:47.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:47.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:48.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:48.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:48.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:48.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:48.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:48.442+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:49.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:49.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:49.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:49.290+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:49.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:49.422+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:50.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:50.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:50.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:50.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:50.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:50.446+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:51.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:51.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:51.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:51.346+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:51.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:51.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:52.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:52.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:52.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:52.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:52.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:52.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:53.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:53.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:53.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:53.366+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:53.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:53.446+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:54.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:54.174+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:54.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:54.330+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:54.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:54.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:55.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:55.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:55.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:55.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:55.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:55.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:56.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:56.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:56.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:56.394+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:56.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:56.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:57.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:57.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:57.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:57.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:57.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:57.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:58.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:58.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:58.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:58.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:58.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:58.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:59.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:11:59.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:11:59.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:11:59.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:11:59.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:11:59.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:00.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:00.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:00.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:00.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:00.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:00.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:01.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:01.118+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:01.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:01.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:01.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:01.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:02.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:02.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:02.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:02.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:02.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:02.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:03.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:03.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:03.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:03.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:03.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:03.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:04.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:04.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:04.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:04.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:04.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:04.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:05.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:05.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:05.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:05.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:05.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:05.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:06.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:06.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:06.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:06.394+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:06.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:06.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:07.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:07.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:07.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:07.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:07.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:07.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:08.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:08.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:08.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:08.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:08.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:08.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:09.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:09.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:09.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:09.334+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:09.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:09.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:10.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:10.118+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:10.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:10.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:10.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:10.382+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:11.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:11.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:11.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:11.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:11.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:11.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:12.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:12.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:12.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:12.310+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:12.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:12.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:13.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:13.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:13.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:13.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:13.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:13.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:14.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:14.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:14.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:14.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:14.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:14.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:15.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:15.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:15.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:15.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:15.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:15.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:16.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:16.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:16.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:16.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:16.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:16.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:17.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:17.090+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:17.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:17.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:17.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:17.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:18.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:18.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:18.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:18.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:18.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:18.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:19.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:19.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:19.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:19.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:19.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:19.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:20.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:20.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:20.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:20.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:20.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:20.354+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:21.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:21.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:21.329 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:21.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:21.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:21.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:22.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:22.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:22.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:22.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:22.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:22.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:23.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:23.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:23.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:23.374+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:23.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:23.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:24.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:24.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:24.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:24.374+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:24.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:24.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:25.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:25.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:25.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:25.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:25.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:25.446+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:26.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:26.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:26.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:26.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:26.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:26.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:27.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:27.274+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:27.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:27.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:27.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:27.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:28.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:28.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:28.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:28.261+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:28.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:28.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:29.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:29.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:29.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:29.245+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:29.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:29.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:30.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:30.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:30.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:30.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:30.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:30.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:31.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:31.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:31.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:31.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:31.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:31.457+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:32.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:32.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:32.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:32.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:32.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:32.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:33.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:33.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:33.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:33.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:33.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:33.389+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:34.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:34.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:34.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:34.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:34.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:34.393+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:35.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:35.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:35.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:35.373+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:35.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:35.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:36.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:36.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:36.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:36.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:36.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:36.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:37.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:37.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:37.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:37.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:37.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:37.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:38.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:38.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:38.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:38.373+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:38.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:38.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:39.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:39.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:39.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:39.393+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:39.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:39.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:40.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:40.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:40.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:40.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:40.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:40.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:41.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:41.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:41.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:41.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:41.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:41.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:42.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:42.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:42.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:42.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:42.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:42.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:43.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:43.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:43.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:43.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:43.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:43.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:44.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:44.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:44.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:44.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:44.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:44.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:45.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:45.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:45.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:45.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:45.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:45.465+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:46.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:46.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:46.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:46.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:46.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:46.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:47.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:47.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:47.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:47.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:47.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:47.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:48.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:48.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:48.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:48.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:48.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:48.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:49.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:49.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:49.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:49.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:49.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:49.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:50.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:50.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:50.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:50.437+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:50.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:50.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:51.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:51.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:51.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:51.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:51.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:51.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:52.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:52.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:52.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:52.465+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:52.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:52.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:53.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:53.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:53.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:53.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:53.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:53.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:54.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:54.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:54.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:54.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:54.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:54.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:55.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:55.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:55.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:55.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:55.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:55.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:56.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:56.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:56.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:56.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:56.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:56.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:57.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:57.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:57.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:57.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:57.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:57.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:58.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:58.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:58.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:58.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:58.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:58.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:59.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:12:59.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:12:59.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:12:59.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:12:59.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:12:59.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:00.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:00.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:00.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:00.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:00.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:00.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:01.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:01.173+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:01.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:01.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:01.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:01.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:02.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:02.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:02.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:02.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:02.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:02.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:03.223 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:03.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:03.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:03.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:03.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:03.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:04.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:04.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:04.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:04.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:04.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:04.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:05.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:05.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:05.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:05.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:05.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:05.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:06.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:06.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:06.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:06.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:06.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:06.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:07.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:07.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:07.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:07.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:07.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:07.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:08.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:08.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:08.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:08.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:08.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:08.745+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:09.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:09.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:09.595 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:09.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:09.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:09.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:10.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:10.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:10.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:10.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:10.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:10.813+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:11.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:11.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:11.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:11.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:11.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:11.829+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:12.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:12.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:12.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:12.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:12.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:12.869+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:13.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:13.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:13.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:13.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:13.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:13.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:14.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:14.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:14.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:14.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:14.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:14.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:15.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:15.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:15.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:15.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:15.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:15.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:16.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:16.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:16.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:16.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:17.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:17.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:17.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:17.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:17.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:17.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:18.015 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:18.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:18.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:18.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:18.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:18.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:19.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:19.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:19.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:19.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:19.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:19.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:20.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:20.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:20.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:20.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:20.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:20.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:21.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:21.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:21.228 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:21.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:21.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:21.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:22.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:22.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:22.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:22.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:22.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:22.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:23.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:23.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:23.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:23.268+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:23.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:23.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:23.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:23.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:24.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:24.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:24.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:24.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:24.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:24.936+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:25.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:25.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:25.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:25.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:25.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:25.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:26.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:26.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:26.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:26.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:27.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:27.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:27.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:27.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:27.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:27.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:28.076 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:28.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:28.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:28.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:28.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:28.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:29.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:29.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:29.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:29.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:29.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:29.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:30.019 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:30.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:30.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:30.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:30.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:30.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:30.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:30.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:31.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:31.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:31.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:31.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:31.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:31.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:32.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:32.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:32.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:32.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:32.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:32.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:33.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:33.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:33.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:33.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:33.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:33.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:34.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:34.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:34.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:34.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:34.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:34.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:35.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:35.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:35.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:35.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:35.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:35.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:36.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:36.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:36.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:36.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:36.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:36.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:37.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:37.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:37.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:37.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:37.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:37.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:38.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:38.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:38.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:38.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:38.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:38.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:39.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:39.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:39.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:39.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:40.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:40.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:40.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:40.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:40.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:40.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:41.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:41.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:41.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:41.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:41.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:41.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:42.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:42.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:42.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:42.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:42.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:42.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:43.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:43.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:43.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:43.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:43.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:43.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:44.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:44.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:44.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:44.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:44.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:44.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:45.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:45.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:45.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:45.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:45.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:45.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:46.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:46.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:46.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:46.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:46.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:46.648+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:47.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:47.100+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:47.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:47.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:47.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:47.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:48.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:48.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:48.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:48.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:48.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:48.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:49.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:49.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:49.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:49.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:49.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:49.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:50.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:50.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:50.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:50.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:50.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:50.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:51.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:51.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:51.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:51.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:51.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:51.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:52.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:52.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:52.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:52.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:52.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:52.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:53.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:53.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:53.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:53.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:53.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:53.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:54.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:54.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:54.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:54.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:54.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:54.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:55.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:55.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:55.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:55.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:55.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:55.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:56.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:56.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:56.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:56.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:56.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:56.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:57.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:57.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:57.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:57.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:57.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:57.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:58.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:58.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:58.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:58.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:58.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:58.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:59.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:13:59.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:13:59.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:13:59.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:13:59.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:13:59.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:00.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:00.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:00.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:00.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:00.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:00.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:01.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:01.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:01.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:01.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:01.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:01.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:02.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:02.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:02.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:02.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:02.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:02.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:03.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:03.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:03.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:03.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:03.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:03.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:04.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:04.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:04.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:04.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:04.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:04.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:05.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:05.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:05.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:05.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:05.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:05.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:06.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:06.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:06.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:06.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:06.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:06.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:07.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:07.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:07.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:07.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:07.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:07.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:08.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:08.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:08.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:08.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:08.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:08.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:09.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:09.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:09.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:09.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:09.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:09.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:10.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:10.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:10.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:10.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:10.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:10.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:11.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:11.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:11.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:11.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:11.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:11.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:12.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:12.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:12.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:12.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:12.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:12.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:13.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:13.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:13.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:13.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:13.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:13.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:14.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:14.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:14.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:14.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:14.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:14.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:15.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:15.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:15.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:15.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:15.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:15.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:16.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:16.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:16.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:16.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:16.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:16.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:17.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:17.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:17.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:17.367+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:17.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:17.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:18.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:18.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:18.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:18.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:18.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:18.943+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:19.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:19.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:19.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:19.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:19.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:19.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:20.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:20.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:20.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:20.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:20.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:20.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:21.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:21.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:21.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:21.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:21.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:21.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:22.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:22.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:22.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:22.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:23.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:23.019+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:23.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:23.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:23.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:23.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:24.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:24.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:24.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:24.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:24.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:24.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:24.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:24.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:25.051 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:25.047+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:25.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:25.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:26.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:26.027+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:26.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:26.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:26.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:26.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:27.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:27.003+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:27.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:27.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:27.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:27.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:28.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:28.039+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:28.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:28.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:28.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:28.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:29.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:29.059+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:29.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:29.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:29.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:29.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:30.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:30.059+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:30.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:30.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:30.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:30.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:31.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:31.051+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:31.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:31.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:31.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:31.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:32.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:32.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:32.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:32.087+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:32.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:32.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:33.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:33.063+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:33.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:33.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:33.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:33.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:34.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:34.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:34.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:34.107+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:34.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:34.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:35.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:35.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:35.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:35.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:35.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:35.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:36.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:36.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:36.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:36.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:36.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:36.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:37.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:37.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:37.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:37.087+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:37.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:37.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:38.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:38.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:38.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:38.135+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:38.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:38.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:39.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:39.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:39.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:39.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:39.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:39.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:40.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:40.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:40.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:40.175+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:40.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:40.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:41.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:41.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:41.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:41.143+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:41.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:41.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:42.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:42.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:42.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:42.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:42.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:42.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:43.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:43.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:43.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:43.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:43.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:43.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:44.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:44.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:44.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:44.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:44.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:44.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:45.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:45.011+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:45.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:45.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:45.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:45.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:46.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:46.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:46.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:46.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:46.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:46.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:47.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:47.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:47.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:47.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:47.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:47.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:48.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:48.007+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:48.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:48.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:48.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:48.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:49.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:48.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:49.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:49.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:49.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:49.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:50.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:50.010+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:50.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:50.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:50.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:50.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:51.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:51.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:51.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:51.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:51.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:51.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:52.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:52.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:52.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:52.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:52.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:52.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:53.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:53.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:53.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:53.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:53.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:53.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:54.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:54.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:54.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:54.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:54.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:54.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:55.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:55.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:55.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:55.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:55.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:55.294+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:56.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:56.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:56.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:56.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:56.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:56.322+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:57.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:57.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:57.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:57.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:57.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:57.302+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:58.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:58.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:58.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:58.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:58.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:58.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:59.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:14:59.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:14:59.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:14:59.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:14:59.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:14:59.290+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:00.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:00.078+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:00.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:00.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:00.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:00.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:01.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:01.058+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:01.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:01.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:01.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:01.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:02.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:02.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:02.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:02.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:02.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:02.282+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:03.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:03.118+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:03.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:03.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:03.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:03.262+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:04.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:04.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:04.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:04.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:04.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:04.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:05.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:05.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:05.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:05.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:05.210 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:05.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:06.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:06.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:06.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:06.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:06.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:06.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:07.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:07.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:07.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:07.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:07.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:07.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:08.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:08.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:08.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:08.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:08.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:08.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:09.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:09.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:09.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:09.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:09.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:09.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:10.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:10.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:10.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:10.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:10.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:10.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:11.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:11.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:11.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:11.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:11.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:11.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:12.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:12.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:12.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:12.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:12.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:12.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:13.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:13.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:13.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:13.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:13.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:13.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:14.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:14.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:14.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:14.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:14.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:14.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:15.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:15.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:15.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:15.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:15.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:15.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:16.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:16.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:16.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:16.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:16.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:16.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:17.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:17.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:17.209 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:17.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:17.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:17.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:18.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:18.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:18.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:18.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:18.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:18.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:19.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:19.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:19.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:19.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:19.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:19.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:20.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:20.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:20.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:20.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:20.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:20.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:21.176 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:21.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:21.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:21.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:21.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:21.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:22.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:22.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:22.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:22.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:22.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:22.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:23.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:23.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:23.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:23.266+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:23.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:23.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:24.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:24.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:24.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:24.222+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:24.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:24.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:25.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:25.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:25.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:25.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:25.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:25.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:26.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:26.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:26.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:26.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:26.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:26.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:27.121 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:27.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:27.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:27.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:27.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:27.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:28.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:28.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:28.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:28.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:28.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:28.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:29.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:29.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:29.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:29.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:29.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:29.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:30.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:30.134+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:30.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:30.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:30.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:30.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:31.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:31.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:31.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:31.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:31.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:31.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:32.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:32.058+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:32.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:32.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:32.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:32.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:33.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:33.038+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:33.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:33.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:33.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:33.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:34.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:34.002+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:34.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:34.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:34.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:34.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:35.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:34.998+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:35.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:35.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:35.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:35.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:35.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:35.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:36.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:36.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:36.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:36.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:36.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:36.941+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:37.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:37.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:37.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:37.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:37.979 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:37.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:38.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:38.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:38.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:38.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:38.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:38.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:39.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:39.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:39.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:39.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:40.015 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:40.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:40.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:40.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:40.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:40.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:41.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:41.013+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:41.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:41.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:41.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:41.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:42.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:42.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:42.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:42.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:42.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:42.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:43.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:43.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:43.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:43.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:43.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:43.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:43.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:43.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:44.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:44.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:44.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:44.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:44.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:44.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:45.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:45.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:45.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:45.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:45.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:45.929+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:46.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:46.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:46.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:46.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:46.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:46.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:47.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:47.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:47.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:47.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:47.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:47.905+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:48.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:48.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:48.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:48.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:48.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:48.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:49.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:49.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:49.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:49.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:49.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:49.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:50.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:50.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:50.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:50.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:50.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:50.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:51.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:51.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:51.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:51.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:51.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:51.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:52.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:52.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:52.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:52.169+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:52.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:52.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:53.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:53.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:53.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:53.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:53.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:53.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:54.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:54.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:54.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:54.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:54.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:54.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:55.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:55.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:55.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:55.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:55.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:55.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:56.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:56.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:56.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:56.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:56.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:56.881+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:57.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:57.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:57.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:57.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:57.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:57.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:58.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:58.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:58.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:58.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:58.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:58.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:59.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:15:59.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:15:59.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:15:59.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:15:59.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:15:59.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:00.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:00.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:00.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:00.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:00.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:00.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:01.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:01.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:01.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:01.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:01.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:01.969+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:02.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:02.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:02.248 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:02.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:02.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:02.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:03.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:03.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:03.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:03.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:03.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:03.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:04.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:04.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:04.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:04.249+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:04.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:04.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:05.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:05.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:05.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:05.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:05.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:05.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:06.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:06.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:06.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:06.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:06.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:06.921+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:07.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:07.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:07.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:07.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:07.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:07.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:08.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:08.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:08.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:08.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:09.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:09.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:09.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:09.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:09.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:09.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:10.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:10.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:10.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:10.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:10.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:10.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:11.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:11.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:11.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:11.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:11.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:11.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:12.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:12.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:12.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:12.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:12.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:12.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:13.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:13.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:13.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:13.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:13.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:13.457+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:14.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:14.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:14.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:14.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:14.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:14.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:15.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:15.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:15.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:15.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:15.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:15.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:16.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:16.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:16.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:16.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:16.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:16.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:17.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:17.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:17.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:17.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:17.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:17.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:18.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:18.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:18.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:18.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:18.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:18.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:19.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:19.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:19.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:19.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:19.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:19.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:20.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:20.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:20.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:20.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:20.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:20.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:21.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:21.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:21.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:21.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:21.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:21.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:22.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:22.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:22.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:22.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:22.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:22.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:23.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:23.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:23.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:23.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:23.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:23.657+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:24.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:24.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:24.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:24.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:24.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:24.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:25.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:25.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:25.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:25.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:25.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:25.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:26.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:26.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:26.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:26.284+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:26.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:26.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:27.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:27.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:27.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:27.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:27.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:27.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:28.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:28.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:28.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:28.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:28.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:28.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:29.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:29.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:29.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:29.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:29.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:29.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:30.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:30.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:30.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:30.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:30.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:30.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:31.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:31.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:31.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:31.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:31.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:31.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:32.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:32.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:32.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:32.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:32.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:32.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:33.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:33.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:33.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:33.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:33.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:33.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:34.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:34.028+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:34.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:34.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:34.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:34.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:34.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:34.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:35.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:35.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:35.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:35.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:36.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:36.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:36.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:36.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:36.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:36.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:37.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:37.052+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:37.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:37.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:37.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:37.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:38.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:38.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:38.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:38.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:38.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:38.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:39.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:39.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:39.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:39.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:39.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:39.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:40.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:40.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:40.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:40.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:40.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:40.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:41.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:41.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:41.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:41.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:41.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:41.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:42.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:42.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:42.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:42.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:42.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:42.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:43.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:43.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:43.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:43.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:43.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:43.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:44.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:44.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:44.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:44.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:44.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:44.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:45.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:45.048+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:45.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:45.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:45.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:45.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:46.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:46.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:46.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:46.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:46.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:46.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:47.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:47.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:47.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:47.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:47.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:47.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:48.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:48.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:48.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:48.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:48.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:48.624+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:49.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:49.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:49.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:49.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:49.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:49.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:50.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:50.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:50.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:50.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:50.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:50.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:51.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:51.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:51.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:51.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:51.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:51.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:52.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:52.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:52.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:52.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:52.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:52.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:53.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:53.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:53.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:53.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:53.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:53.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:54.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:54.112+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:54.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:54.168+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:54.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:54.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:55.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:55.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:55.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:55.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:55.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:55.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:56.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:56.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:56.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:56.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:56.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:56.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:57.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:57.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:57.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:57.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:57.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:57.652+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:58.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:58.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:58.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:58.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:58.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:58.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:16:59.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:16:59.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:59.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:16:59.148+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:16:59.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:16:59.680+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:00.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:00.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:00.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:00.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:00.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:00.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:01.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:01.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:01.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:01.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:01.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:01.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:02.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:02.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:02.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:02.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:02.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:02.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:03.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:03.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:03.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:03.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:03.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:03.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:04.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:04.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:04.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:04.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:04.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:04.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:05.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:05.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:05.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:05.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:05.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:05.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:06.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:06.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:06.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:06.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:06.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:06.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:07.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:07.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:07.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:07.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:07.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:07.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:08.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:08.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:08.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:08.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:08.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:08.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:09.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:09.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:09.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:09.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:09.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:09.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:10.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:10.024+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:10.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:10.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:10.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:10.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:10.994 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:10.991+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:11.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:11.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:11.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:11.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:12.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:12.019+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:12.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:12.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:12.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:12.615+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:12.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:12.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:13.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:13.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:13.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:13.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:13.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:13.955+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:14.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:14.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:14.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:14.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:14.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:14.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:15.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:15.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:15.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:15.615+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:16.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:16.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:16.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:16.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:16.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:16.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:17.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:17.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:17.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:17.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:17.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:17.639+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:17.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:17.967+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:18.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:18.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:18.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:18.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:18.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:18.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:19.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:19.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:19.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:19.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:20.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:19.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:20.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:20.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:20.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:20.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:21.018 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:21.015+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:21.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:21.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:21.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:21.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:22.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:22.063+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:22.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:22.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:22.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:22.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:23.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:23.019+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:23.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:23.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:23.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:23.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:23.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:23.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:24.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:24.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:24.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:24.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:25.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:25.011+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:25.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:25.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:25.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:25.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:26.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:26.019+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:26.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:26.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:26.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:26.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:26.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:26.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:27.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:27.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:27.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:27.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:27.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:27.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:28.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:28.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:28.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:28.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:29.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:28.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:29.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:29.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:29.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:29.699+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:30.015 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:30.011+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:30.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:30.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:30.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:30.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:30.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:30.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:31.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:31.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:31.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:31.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:31.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:31.991+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:32.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:32.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:32.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:32.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:32.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:32.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:33.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:33.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:33.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:33.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:34.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:33.999+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:34.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:34.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:34.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:34.679+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:34.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:34.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:35.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:35.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:35.724 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:35.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:36.035 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:36.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:36.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:36.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:36.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:36.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:37.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:37.003+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:37.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:37.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:37.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:37.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:38.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:38.023+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:38.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:38.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:38.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:38.679+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:39.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:39.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:39.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:39.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:39.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:39.679+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:40.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:39.999+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:40.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:40.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:40.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:40.695+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:40.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:40.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:41.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:41.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:41.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:41.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:42.015 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:42.011+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:42.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:42.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:42.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:42.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:42.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:42.963+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:43.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:43.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:43.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:43.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:43.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:43.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:44.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:44.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:44.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:44.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:44.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:44.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:45.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:45.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:45.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:45.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:45.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:45.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:46.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:46.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:46.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:46.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:46.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:46.943+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:47.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:47.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:47.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:47.803+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:47.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:47.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:48.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:48.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:48.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:48.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:48.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:48.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:49.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:49.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:49.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:49.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:50.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:49.999+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:50.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:50.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:50.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:50.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:50.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:50.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:51.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:51.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:51.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:51.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:52.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:52.003+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:52.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:52.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:52.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:52.731+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:53.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:53.003+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:53.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:53.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:53.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:53.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:53.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:53.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:54.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:54.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:54.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:54.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:54.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:54.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:55.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:55.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:55.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:55.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:55.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:55.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:56.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:56.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:56.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:56.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:56.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:56.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:57.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:57.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:57.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:57.810+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:57.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:57.958+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:58.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:58.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:58.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:58.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:58.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:58.950+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:59.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:17:59.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:17:59.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:17:59.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:17:59.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:17:59.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:00.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:00.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:00.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:00.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:00.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:00.974+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:01.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:01.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:01.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:01.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:02.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:02.006+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:02.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:02.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:02.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:02.862+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:03.029 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:03.022+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:03.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:03.058+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:03.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:03.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:04.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:04.002+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:04.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:04.018+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:04.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:04.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:05.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:05.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:05.026 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:05.022+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:05.821 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:05.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:06.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:06.030+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:06.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:06.034+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:06.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:06.838+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:07.035 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:07.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:07.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:07.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:07.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:07.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:08.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:08.050+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:08.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:08.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:08.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:08.782+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:09.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:09.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:09.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:09.090+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:09.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:09.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:10.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:10.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:10.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:10.102+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:10.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:10.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:11.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:11.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:11.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:11.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:11.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:11.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:12.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:12.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:12.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:12.102+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:12.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:12.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:13.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:13.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:13.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:13.090+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:13.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:13.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:14.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:14.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:14.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:14.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:14.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:14.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:15.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:15.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:15.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:15.150+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:15.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:15.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:16.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:16.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:16.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:16.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:16.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:16.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:17.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:17.018+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:17.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:17.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:17.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:17.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:18.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:18.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:18.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:18.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:18.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:18.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:19.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:19.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:19.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:19.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:19.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:19.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:20.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:20.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:20.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:20.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:20.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:20.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:21.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:21.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:21.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:21.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:21.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:21.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:22.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:22.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:22.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:22.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:22.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:22.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:23.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:23.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:23.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:23.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:23.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:23.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:24.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:24.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:24.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:24.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:24.728 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:24.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:25.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:25.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:25.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:25.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:25.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:25.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:26.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:26.030+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:26.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:26.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:26.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:26.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:27.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:26.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:27.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:27.186+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:27.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:27.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:27.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:27.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:28.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:28.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:28.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:28.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:28.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:28.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:29.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:29.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:29.769 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:29.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:29.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:29.974+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:30.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:30.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:30.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:30.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:30.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:30.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:31.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:31.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:31.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:31.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:31.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:31.986+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:32.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:32.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:32.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:32.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:32.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:32.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:33.249 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:33.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:33.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:33.770+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:33.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:33.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:34.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:34.250+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:34.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:34.758+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:34.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:34.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:35.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:35.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:35.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:35.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:35.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:35.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:36.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:36.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:36.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:36.750+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:36.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:36.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:37.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:37.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:37.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:37.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:37.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:37.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:38.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:38.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:38.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:38.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:38.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:38.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:39.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:39.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:39.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:39.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:39.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:39.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:40.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:40.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:40.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:40.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:40.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:40.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:41.305 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:41.298+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:41.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:41.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:41.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:41.910+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:42.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:42.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:42.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:42.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:42.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:42.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:43.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:43.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:43.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:43.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:43.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:43.930+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:44.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:44.222+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:44.843 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:44.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:44.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:44.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:45.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:45.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:45.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:45.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:45.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:45.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:46.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:46.177+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:46.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:46.845+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:46.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:46.893+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:47.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:47.149+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:47.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:47.873+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:47.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:47.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:48.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:48.133+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:48.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:48.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:48.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:48.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:49.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:49.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:49.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:49.877+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:49.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:49.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:50.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:50.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:50.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:50.861+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:50.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:50.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:51.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:51.245+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:51.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:51.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:51.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:51.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:52.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:52.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:52.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:52.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:53.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:52.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:53.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:53.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:53.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:53.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:54.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:54.033+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:54.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:54.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:54.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:54.793+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:55.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:54.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:55.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:55.229+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:55.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:55.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:56.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:55.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:56.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:56.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:56.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:56.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:56.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:56.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:57.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:57.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:57.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:57.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:57.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:57.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:58.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:58.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:58.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:58.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:58.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:58.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:59.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:18:59.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:18:59.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:18:59.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:18:59.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:18:59.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:00.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:00.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:00.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:00.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:00.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:00.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:01.317 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:01.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:01.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:01.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:01.974 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:01.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:02.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:02.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:02.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:02.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:02.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:02.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:03.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:03.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:03.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:03.877+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:03.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:03.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:04.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:04.317+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:04.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:04.841+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:04.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:04.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:05.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:05.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:05.803 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:05.801+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:05.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:05.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:06.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:06.317+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:06.824 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:06.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:06.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:06.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:07.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:07.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:07.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:07.781+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:07.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:07.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:08.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:08.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:08.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:08.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:08.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:08.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:09.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:09.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:09.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:09.813+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:09.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:09.869+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:10.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:10.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:10.821 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:10.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:10.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:10.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:11.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:11.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:11.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:11.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:11.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:11.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:12.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:12.249+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:12.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:12.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:12.862 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:12.861+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:13.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:13.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:13.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:13.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:13.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:13.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:14.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:14.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:14.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:14.785+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:14.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:14.857+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:15.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:15.229+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:15.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:15.769+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:15.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:15.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:16.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:16.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:16.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:16.745+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:16.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:16.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:17.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:17.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:17.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:17.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:17.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:17.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:18.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:18.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:18.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:18.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:18.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:18.765+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:19.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:19.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:19.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:19.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:19.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:19.785+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:20.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:20.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:20.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:20.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:20.831 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:20.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:21.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:21.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:21.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:21.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:21.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:21.861+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:22.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:22.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:22.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:22.681+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:22.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:22.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:23.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:23.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:23.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:23.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:23.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:23.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:24.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:24.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:24.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:24.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:24.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:24.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:25.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:25.333+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:25.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:25.629+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:25.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:25.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:26.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:26.317+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:26.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:26.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:26.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:26.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:27.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:27.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:27.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:27.609+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:27.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:27.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:28.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:28.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:28.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:28.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:28.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:28.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:29.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:29.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:29.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:29.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:29.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:29.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:30.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:30.241+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:30.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:30.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:30.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:30.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:31.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:31.241+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:31.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:31.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:31.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:31.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:32.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:32.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:32.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:32.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:32.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:32.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:33.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:33.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:33.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:33.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:33.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:33.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:34.255 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:34.252+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:34.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:34.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:34.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:34.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:35.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:35.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:35.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:35.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:36.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:36.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:36.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:36.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:36.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:36.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:37.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:37.048+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:37.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:37.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:37.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:37.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:38.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:38.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:38.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:38.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:38.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:38.632+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:38.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:38.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:39.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:39.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:39.677 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:39.672+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:40.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:40.012+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:40.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:40.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:40.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:40.632+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:41.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:41.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:41.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:41.252+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:41.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:41.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:42.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:42.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:42.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:42.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:42.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:42.600+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:42.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:42.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:43.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:43.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:43.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:43.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:43.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:43.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:44.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:44.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:44.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:44.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:45.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:45.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:45.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:45.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:45.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:45.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:45.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:45.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:46.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:46.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:46.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:46.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:46.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:46.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:47.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:47.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:47.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:47.536+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:47.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:47.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:48.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:48.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:48.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:48.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:49.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:49.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:49.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:49.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:49.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:49.516+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:49.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:49.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:50.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:50.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:50.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:50.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:50.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:50.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:51.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:51.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:51.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:51.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:51.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:51.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:52.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:52.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:52.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:52.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:52.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:52.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:53.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:53.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:53.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:53.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:54.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:54.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:54.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:54.276+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:54.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:54.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:55.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:55.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:55.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:55.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:55.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:55.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:55.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:55.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:56.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:56.280+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:56.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:56.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:56.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:56.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:57.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:57.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:57.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:57.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:57.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:57.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:58.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:58.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:58.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:58.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:59.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:59.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:19:59.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:19:59.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:19:59.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:19:59.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:00.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:19:59.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:00.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:00.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:00.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:00.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:01.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:01.016+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:01.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:01.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:01.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:01.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:02.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:02.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:02.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:02.328+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:02.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:02.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:02.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:02.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:03.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:03.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:03.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:03.736+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:03.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:03.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:04.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:04.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:04.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:04.712+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:04.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:04.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:05.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:05.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:05.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:05.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:05.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:05.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:06.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:06.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:06.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:06.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:06.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:06.932+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:07.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:07.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:07.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:07.680+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:07.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:07.932+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:08.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:08.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:08.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:08.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:08.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:08.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:09.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:09.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:09.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:09.704+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:09.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:09.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:10.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:10.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:10.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:10.680+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:10.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:10.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:11.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:11.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:11.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:11.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:11.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:11.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:12.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:12.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:12.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:12.672+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:12.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:12.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:13.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:13.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:13.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:13.636+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:13.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:13.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:14.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:14.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:14.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:14.684+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:14.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:14.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:15.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:15.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:15.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:15.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:15.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:15.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:16.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:16.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:16.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:16.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:16.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:16.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:17.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:17.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:17.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:17.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:18.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:18.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:18.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:18.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:18.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:18.700+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:19.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:19.007+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:19.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:19.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:19.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:19.667+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:20.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:20.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:20.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:20.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:20.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:20.711+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:21.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:21.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:21.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:21.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:21.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:21.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:22.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:22.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:22.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:22.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:22.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:22.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:23.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:23.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:23.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:23.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:23.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:23.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:24.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:24.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:24.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:24.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:24.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:24.739+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:25.036 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:25.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:25.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:25.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:25.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:25.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:26.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:26.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:26.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:26.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:26.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:26.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:27.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:27.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:27.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:27.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:27.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:27.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:28.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:28.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:28.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:28.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:28.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:28.715+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:29.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:29.107+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:29.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:29.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:29.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:29.679+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:30.149 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:30.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:30.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:30.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:30.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:30.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:31.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:31.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:31.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:31.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:31.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:31.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:32.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:32.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:32.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:32.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:32.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:32.667+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:33.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:33.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:33.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:33.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:33.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:33.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:34.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:34.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:34.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:34.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:34.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:34.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:35.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:35.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:35.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:35.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:35.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:35.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:36.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:36.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:36.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:36.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:36.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:36.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:37.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:37.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:37.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:37.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:37.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:37.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:38.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:38.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:38.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:38.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:38.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:38.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:39.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:39.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:39.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:39.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:39.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:39.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:40.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:40.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:40.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:40.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:40.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:40.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:41.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:41.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:41.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:41.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:41.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:41.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:42.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:42.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:42.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:42.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:42.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:42.679+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:43.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:43.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:43.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:43.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:43.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:43.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:44.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:44.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:44.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:44.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:44.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:44.703+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:45.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:45.139+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:45.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:45.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:45.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:45.675+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:46.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:46.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:46.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:46.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:46.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:46.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:47.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:47.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:47.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:47.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:47.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:47.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:48.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:48.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:48.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:48.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:48.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:48.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:49.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:49.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:49.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:49.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:49.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:49.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:50.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:50.139+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:50.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:50.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:50.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:50.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:51.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:51.107+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:51.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:51.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:51.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:51.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:52.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:52.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:52.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:52.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:52.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:52.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:53.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:53.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:53.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:53.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:53.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:53.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:54.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:54.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:54.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:54.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:54.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:54.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:55.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:55.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:55.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:55.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:55.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:55.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:56.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:56.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:56.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:56.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:56.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:56.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:57.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:57.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:57.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:57.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:57.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:57.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:58.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:58.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:58.364 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:58.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:58.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:58.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:59.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:59.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:20:59.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:20:59.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:59.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:20:59.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:20:59.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:20:59.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:00.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:00.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:00.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:00.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:00.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:00.927+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:01.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:01.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:01.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:01.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:01.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:01.959+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:02.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:02.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:02.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:02.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:02.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:02.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:03.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:03.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:03.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:03.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:03.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:03.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:04.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:04.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:04.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:04.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:04.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:04.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:05.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:05.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:05.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:05.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:05.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:05.851+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:06.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:06.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:06.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:06.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:06.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:06.858+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:07.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:07.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:07.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:07.630+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:07.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:07.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:08.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:08.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:08.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:08.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:08.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:08.810+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:09.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:09.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:09.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:09.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:09.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:09.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:10.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:10.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:10.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:10.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:10.766 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:10.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:11.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:11.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:11.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:11.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:11.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:11.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:12.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:12.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:12.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:12.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:12.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:12.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:13.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:13.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:13.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:13.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:13.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:13.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:14.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:14.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:14.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:14.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:14.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:14.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:15.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:15.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:15.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:15.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:15.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:15.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:16.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:16.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:16.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:16.650+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:16.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:16.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:17.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:17.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:17.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:17.638+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:17.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:17.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:18.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:18.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:18.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:18.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:18.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:18.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:19.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:19.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:19.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:19.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:19.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:19.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:20.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:20.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:20.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:20.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:20.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:20.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:21.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:21.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:21.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:21.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:21.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:21.798+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:22.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:22.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:22.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:22.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:22.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:22.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:23.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:23.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:23.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:23.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:23.797 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:23.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:24.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:24.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:24.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:24.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:24.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:24.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:25.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:25.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:25.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:25.782+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:25.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:25.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:26.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:26.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:26.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:26.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:26.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:26.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:27.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:27.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:27.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:27.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:27.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:27.910+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:28.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:28.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:28.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:28.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:28.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:28.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:29.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:29.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:29.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:29.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:29.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:29.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:30.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:30.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:30.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:30.770+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:30.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:30.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:31.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:31.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:31.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:31.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:31.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:31.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:32.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:32.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:32.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:32.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:32.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:32.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:33.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:33.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:33.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:33.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:33.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:33.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:34.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:34.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:34.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:34.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:34.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:34.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:35.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:35.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:35.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:35.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:35.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:35.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:36.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:36.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:36.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:36.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:36.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:36.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:37.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:37.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:37.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:37.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:37.871 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:37.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:38.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:38.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:38.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:38.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:38.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:38.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:39.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:39.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:39.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:39.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:39.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:39.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:40.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:40.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:40.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:40.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:40.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:40.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:41.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:41.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:41.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:41.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:41.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:41.906+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:42.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:42.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:42.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:42.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:42.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:42.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:43.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:43.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:43.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:43.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:43.890 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:43.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:44.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:44.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:44.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:44.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:44.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:44.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:45.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:45.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:45.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:45.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:45.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:45.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:46.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:46.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:46.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:46.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:46.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:46.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:47.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:47.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:47.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:47.562+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:47.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:47.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:48.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:48.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:48.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:48.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:48.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:48.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:49.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:49.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:49.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:49.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:49.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:49.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:50.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:50.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:50.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:50.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:50.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:50.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:51.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:51.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:51.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:51.518+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:51.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:51.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:52.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:52.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:52.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:52.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:52.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:52.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:53.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:53.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:53.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:53.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:53.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:53.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:54.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:54.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:54.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:54.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:54.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:54.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:55.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:55.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:55.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:55.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:55.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:55.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:56.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:56.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:56.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:56.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:56.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:56.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:57.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:57.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:57.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:57.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:57.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:57.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:58.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:58.485+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:58.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:58.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:58.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:58.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:59.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:21:59.457+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:21:59.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:21:59.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:21:59.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:21:59.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:00.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:00.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:00.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:00.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:00.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:00.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:01.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:01.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:01.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:01.529+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:01.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:01.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:02.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:02.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:02.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:02.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:02.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:02.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:03.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:03.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:03.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:03.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:03.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:03.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:04.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:04.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:04.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:04.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:04.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:04.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:05.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:05.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:05.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:05.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:05.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:05.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:06.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:06.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:06.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:06.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:06.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:06.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:07.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:07.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:07.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:07.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:07.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:07.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:08.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:08.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:08.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:08.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:08.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:08.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:09.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:09.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:09.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:09.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:09.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:09.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:10.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:10.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:10.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:10.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:10.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:10.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:11.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:11.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:11.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:11.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:11.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:11.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:12.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:12.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:12.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:12.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:12.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:12.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:13.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:13.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:13.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:13.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:13.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:13.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:14.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:14.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:14.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:14.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:14.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:14.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:15.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:15.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:15.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:15.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:15.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:15.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:16.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:16.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:16.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:16.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:16.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:16.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:17.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:17.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:17.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:17.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:17.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:17.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:18.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:18.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:18.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:18.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:18.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:18.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:19.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:19.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:19.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:19.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:19.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:19.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:20.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:20.369+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:20.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:20.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:20.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:20.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:21.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:21.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:21.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:21.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:21.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:21.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:22.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:22.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:22.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:22.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:22.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:22.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:23.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:23.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:23.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:23.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:23.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:23.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:24.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:24.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:24.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:24.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:24.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:24.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:25.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:25.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:25.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:25.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:25.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:25.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:26.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:26.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:26.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:26.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:26.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:26.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:27.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:27.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:27.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:27.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:27.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:27.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:28.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:28.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:28.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:28.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:28.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:28.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:29.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:29.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:29.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:29.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:29.684 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:29.681+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:30.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:30.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:30.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:30.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:30.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:30.641+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:31.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:31.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:31.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:31.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:31.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:31.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:32.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:32.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:32.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:32.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:32.696 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:32.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:33.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:33.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:33.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:33.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:33.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:33.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:34.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:34.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:34.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:34.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:34.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:34.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:35.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:35.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:35.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:35.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:35.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:35.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:36.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:36.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:36.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:36.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:36.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:36.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:37.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:37.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:37.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:37.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:37.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:37.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:38.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:38.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:38.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:38.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:38.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:38.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:39.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:39.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:39.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:39.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:39.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:39.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:40.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:40.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:40.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:40.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:40.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:40.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:41.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:41.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:41.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:41.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:41.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:41.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:42.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:42.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:42.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:42.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:42.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:42.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:43.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:43.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:43.488 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:43.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:43.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:43.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:44.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:44.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:44.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:44.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:44.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:44.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:45.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:45.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:45.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:45.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:45.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:45.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:46.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:46.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:46.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:46.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:46.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:46.728+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:47.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:47.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:47.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:47.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:47.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:47.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:48.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:48.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:48.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:48.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:48.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:48.700+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:49.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:49.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:49.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:49.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:49.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:49.680+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:50.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:50.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:50.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:50.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:50.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:50.656+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:51.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:51.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:51.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:51.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:51.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:51.668+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:52.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:52.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:52.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:52.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:52.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:52.648+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:53.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:53.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:53.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:53.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:53.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:53.608+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:54.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:54.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:54.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:54.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:54.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:54.580+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:55.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:55.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:55.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:55.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:55.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:55.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:56.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:56.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:56.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:56.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:56.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:56.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:57.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:57.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:57.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:57.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:57.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:57.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:58.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:58.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:58.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:58.548+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:58.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:58.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:59.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:22:59.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:22:59.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:22:59.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:22:59.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:22:59.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:00.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:00.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:00.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:00.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:00.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:00.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:01.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:01.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:01.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:01.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:01.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:01.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:02.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:02.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:02.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:02.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:02.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:02.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:03.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:03.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:03.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:03.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:03.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:03.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:04.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:04.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:04.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:04.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:04.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:04.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:05.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:05.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:05.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:05.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:05.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:05.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:06.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:06.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:06.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:06.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:06.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:06.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:07.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:07.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:07.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:07.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:07.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:07.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:08.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:08.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:08.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:08.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:08.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:08.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:09.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:09.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:09.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:09.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:09.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:09.632+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:10.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:10.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:10.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:10.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:10.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:10.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:11.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:11.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:11.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:11.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:11.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:11.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:12.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:12.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:12.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:12.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:12.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:12.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:13.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:13.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:13.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:13.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:13.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:13.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:14.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:14.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:14.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:14.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:14.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:14.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:15.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:15.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:15.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:15.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:15.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:15.656+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:16.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:16.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:16.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:16.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:16.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:16.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:17.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:17.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:17.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:17.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:17.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:17.656+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:18.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:18.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:18.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:18.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:18.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:18.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:19.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:19.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:19.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:19.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:19.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:19.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:20.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:20.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:20.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:20.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:20.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:20.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:21.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:21.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:21.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:21.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:21.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:21.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:22.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:22.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:22.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:22.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:22.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:22.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:23.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:23.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:23.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:23.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:23.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:23.660+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:24.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:24.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:24.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:24.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:24.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:24.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:25.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:25.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:25.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:25.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:25.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:25.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:26.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:26.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:26.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:26.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:26.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:26.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:27.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:27.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:27.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:27.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:27.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:27.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:28.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:28.395+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:28.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:28.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:28.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:28.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:29.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:29.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:29.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:29.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:29.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:29.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:30.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:30.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:30.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:30.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:30.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:30.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:31.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:31.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:31.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:31.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:31.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:31.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:32.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:32.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:32.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:32.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:32.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:32.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:33.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:33.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:33.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:33.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:33.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:33.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:34.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:34.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:34.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:34.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:34.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:34.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:35.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:35.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:35.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:35.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:35.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:35.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:36.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:36.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:36.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:36.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:36.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:36.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:37.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:37.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:37.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:37.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:37.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:37.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:38.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:38.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:38.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:38.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:38.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:38.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:39.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:39.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:39.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:39.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:39.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:39.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:40.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:40.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:40.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:40.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:40.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:40.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:41.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:41.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:41.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:41.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:41.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:41.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:42.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:42.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:42.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:42.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:42.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:42.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:43.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:43.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:43.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:43.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:43.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:43.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:44.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:44.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:44.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:44.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:44.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:44.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:45.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:45.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:45.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:45.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:45.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:45.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:46.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:46.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:46.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:46.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:46.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:46.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:47.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:47.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:47.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:47.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:47.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:47.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:48.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:48.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:48.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:48.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:48.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:48.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:49.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:49.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:49.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:49.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:49.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:49.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:50.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:50.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:50.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:50.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:50.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:50.659+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:51.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:51.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:51.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:51.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:51.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:51.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:52.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:52.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:52.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:52.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:52.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:52.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:53.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:53.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:53.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:53.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:53.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:53.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:54.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:54.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:54.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:54.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:54.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:54.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:55.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:55.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:55.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:55.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:55.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:55.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:56.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:56.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:56.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:56.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:56.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:56.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:57.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:57.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:57.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:57.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:57.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:57.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:58.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:58.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:58.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:58.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:58.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:58.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:59.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:23:59.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:23:59.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:23:59.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:23:59.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:23:59.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:00.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:00.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:00.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:00.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:00.637 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:00.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:01.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:01.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:01.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:01.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:01.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:01.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:02.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:02.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:02.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:02.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:02.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:02.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:03.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:03.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:03.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:03.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:03.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:03.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:04.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:04.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:04.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:04.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:04.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:04.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:05.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:05.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:05.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:05.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:05.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:05.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:06.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:06.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:06.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:06.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:06.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:06.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:07.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:07.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:07.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:07.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:07.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:07.671+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:08.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:08.279+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:08.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:08.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:08.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:08.671+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:09.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:09.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:09.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:09.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:09.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:09.667+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:10.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:10.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:10.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:10.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:10.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:10.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:11.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:11.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:11.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:11.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:11.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:11.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:12.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:12.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:12.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:12.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:12.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:12.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:13.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:13.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:13.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:13.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:13.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:13.679+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:14.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:14.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:14.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:14.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:14.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:14.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:15.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:15.386+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:15.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:15.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:15.681 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:15.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:16.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:16.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:16.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:16.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:16.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:16.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:17.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:17.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:17.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:17.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:17.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:17.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:18.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:18.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:18.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:18.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:18.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:18.642+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:19.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:19.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:19.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:19.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:19.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:19.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:20.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:20.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:20.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:20.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:20.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:20.706+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:21.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:21.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:21.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:21.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:21.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:21.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:22.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:22.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:22.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:22.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:22.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:22.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:23.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:23.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:23.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:23.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:23.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:23.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:24.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:24.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:24.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:24.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:24.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:24.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:25.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:25.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:25.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:25.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:25.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:25.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:26.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:26.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:26.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:26.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:26.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:26.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:27.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:27.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:27.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:27.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:27.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:27.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:28.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:28.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:28.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:28.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:28.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:28.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:29.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:29.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:29.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:29.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:29.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:29.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:30.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:30.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:30.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:30.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:30.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:30.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:31.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:31.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:31.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:31.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:31.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:31.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:32.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:32.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:32.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:32.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:32.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:32.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:33.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:33.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:33.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:33.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:33.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:33.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:34.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:34.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:34.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:34.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:34.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:34.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:35.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:35.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:35.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:35.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:35.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:35.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:36.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:36.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:36.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:36.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:36.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:36.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:37.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:37.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:37.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:37.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:37.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:37.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:38.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:38.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:38.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:38.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:38.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:38.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:39.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:39.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:39.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:39.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:39.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:39.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:40.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:40.562+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:40.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:40.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:40.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:40.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:41.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:41.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:41.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:41.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:41.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:41.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:42.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:42.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:42.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:42.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:42.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:42.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:43.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:43.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:43.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:43.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:43.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:43.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:44.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:44.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:44.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:44.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:44.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:44.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:45.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:45.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:45.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:45.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:45.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:45.718+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:46.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:46.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:46.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:46.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:46.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:46.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:47.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:47.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:47.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:47.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:47.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:47.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:48.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:48.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:48.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:48.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:48.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:48.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:49.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:49.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:49.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:49.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:49.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:49.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:50.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:50.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:50.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:50.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:50.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:50.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:51.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:51.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:51.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:51.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:51.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:51.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:52.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:52.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:52.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:52.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:52.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:52.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:53.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:53.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:53.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:53.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:53.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:53.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:54.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:54.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:54.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:54.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:54.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:54.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:55.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:55.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:55.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:55.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:55.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:55.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:56.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:56.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:56.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:56.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:56.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:56.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:57.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:57.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:57.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:57.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:57.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:57.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:58.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:58.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:58.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:58.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:58.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:58.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:59.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:24:59.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:24:59.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:24:59.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:24:59.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:24:59.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:00.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:00.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:00.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:00.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:00.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:00.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:01.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:01.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:01.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:01.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:01.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:01.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:02.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:02.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:02.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:02.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:02.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:02.633+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:03.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:03.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:03.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:03.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:03.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:03.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:04.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:04.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:04.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:04.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:04.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:04.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:05.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:05.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:05.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:05.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:05.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:05.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:06.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:06.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:06.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:06.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:06.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:06.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:07.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:07.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:07.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:07.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:07.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:07.745+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:08.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:08.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:08.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:08.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:08.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:08.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:09.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:09.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:09.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:09.557+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:09.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:09.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:10.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:10.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:10.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:10.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:10.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:10.829+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:11.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:11.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:11.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:11.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:11.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:11.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:12.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:12.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:12.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:12.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:12.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:12.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:13.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:13.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:13.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:13.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:13.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:13.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:14.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:14.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:14.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:14.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:14.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:14.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:15.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:15.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:15.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:15.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:15.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:15.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:16.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:16.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:16.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:16.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:16.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:16.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:17.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:17.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:17.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:17.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:17.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:17.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:18.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:18.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:18.595 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:18.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:18.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:18.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:19.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:19.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:19.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:19.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:19.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:19.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:20.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:20.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:20.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:20.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:20.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:20.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:21.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:21.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:21.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:21.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:21.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:21.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:22.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:22.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:22.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:22.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:22.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:22.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:23.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:23.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:23.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:23.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:23.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:23.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:24.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:24.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:24.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:24.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:24.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:24.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:25.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:25.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:25.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:25.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:25.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:25.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:26.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:26.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:26.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:26.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:26.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:26.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:27.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:27.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:27.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:27.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:27.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:27.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:28.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:28.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:28.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:28.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:29.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:29.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:29.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:29.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:29.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:29.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:30.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:30.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:30.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:30.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:30.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:30.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:31.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:31.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:31.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:31.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:31.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:31.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:32.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:32.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:32.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:32.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:32.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:32.733+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:33.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:33.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:33.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:33.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:33.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:33.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:34.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:34.017+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:34.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:34.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:34.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:34.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:34.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:34.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:35.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:35.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:35.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:35.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:35.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:35.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:36.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:36.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:36.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:36.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:36.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:36.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:37.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:37.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:37.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:37.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:37.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:37.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:38.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:38.453+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:38.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:38.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:38.875 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:38.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:39.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:39.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:39.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:39.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:39.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:39.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:40.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:40.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:40.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:40.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:40.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:40.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:41.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:41.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:41.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:41.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:41.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:41.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:42.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:42.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:42.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:42.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:42.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:42.809+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:43.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:43.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:43.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:43.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:43.862 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:43.861+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:44.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:44.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:44.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:44.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:44.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:44.865+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:45.427 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:45.425+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:45.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:45.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:45.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:45.861+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:46.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:46.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:46.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:46.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:46.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:46.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:47.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:47.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:47.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:47.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:47.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:47.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:48.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:48.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:48.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:48.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:48.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:48.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:49.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:49.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:49.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:49.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:49.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:49.976+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:50.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:50.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:50.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:50.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:50.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:50.936+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:51.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:51.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:51.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:51.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:51.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:51.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:52.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:52.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:52.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:52.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:52.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:52.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:53.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:53.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:53.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:53.668+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:53.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:53.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:54.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:54.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:54.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:54.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:54.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:54.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:55.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:55.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:55.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:55.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:55.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:55.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:56.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:56.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:56.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:56.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:56.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:56.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:57.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:57.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:57.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:57.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:57.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:57.892+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:58.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:58.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:58.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:58.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:58.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:58.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:59.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:25:59.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:25:59.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:25:59.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:25:59.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:25:59.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:00.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:00.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:00.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:00.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:00.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:00.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:01.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:01.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:01.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:01.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:01.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:01.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:02.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:02.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:02.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:02.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:02.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:02.888+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:03.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:03.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:03.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:03.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:03.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:03.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:04.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:04.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:04.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:04.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:04.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:04.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:05.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:05.328+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:05.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:05.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:06.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:06.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:06.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:06.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:06.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:06.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:07.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:07.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:07.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:07.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:07.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:07.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:08.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:07.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:08.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:08.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:08.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:08.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:09.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:09.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:09.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:09.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:09.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:09.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:10.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:10.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:10.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:10.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:10.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:10.724+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:11.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:11.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:11.446 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:11.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:11.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:11.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:12.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:12.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:12.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:12.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:12.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:12.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:13.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:13.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:13.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:13.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:13.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:13.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:14.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:14.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:14.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:14.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:14.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:14.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:15.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:15.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:15.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:15.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:15.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:15.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:16.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:16.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:16.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:16.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:16.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:16.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:17.020 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:17.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:17.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:17.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:17.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:17.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:18.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:18.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:18.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:18.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:18.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:18.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:18.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:18.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:19.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:19.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:19.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:19.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:20.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:20.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:20.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:20.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:20.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:20.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:21.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:20.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:21.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:21.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:21.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:21.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:21.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:21.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:22.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:22.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:22.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:22.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:22.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:22.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:23.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:23.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:23.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:23.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:23.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:23.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:24.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:24.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:24.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:24.552+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:24.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:24.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:25.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:25.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:25.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:25.524+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:25.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:25.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:26.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:26.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:26.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:26.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:26.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:26.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:27.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:27.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:27.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:27.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:27.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:27.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:28.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:28.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:28.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:28.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:29.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:29.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:29.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:29.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:29.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:29.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:30.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:30.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:30.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:30.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:30.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:30.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:31.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:31.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:31.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:31.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:31.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:31.508+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:32.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:32.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:32.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:32.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:32.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:32.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:33.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:33.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:33.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:33.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:33.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:33.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:34.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:34.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:34.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:34.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:34.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:34.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:35.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:35.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:35.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:35.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:35.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:35.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:36.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:36.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:36.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:36.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:36.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:36.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:37.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:37.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:37.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:37.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:37.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:37.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:38.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:38.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:38.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:38.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:38.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:38.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:39.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:39.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:39.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:39.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:39.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:39.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:40.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:40.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:40.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:40.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:40.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:40.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:41.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:41.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:41.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:41.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:41.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:41.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:42.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:42.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:42.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:42.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:42.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:42.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:43.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:43.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:43.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:43.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:43.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:43.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:44.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:44.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:44.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:44.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:44.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:44.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:45.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:45.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:45.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:45.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:45.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:45.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:46.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:46.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:46.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:46.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:46.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:46.587+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:47.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:47.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:47.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:47.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:47.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:47.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:48.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:48.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:48.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:48.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:48.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:48.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:49.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:49.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:49.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:49.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:49.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:49.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:50.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:50.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:50.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:50.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:50.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:50.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:51.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:51.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:51.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:51.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:51.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:51.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:52.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:52.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:52.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:52.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:52.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:52.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:53.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:53.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:53.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:53.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:53.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:53.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:54.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:54.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:54.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:54.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:54.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:54.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:55.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:55.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:55.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:55.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:55.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:55.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:56.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:56.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:56.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:56.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:56.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:56.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:57.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:57.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:57.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:57.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:57.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:57.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:58.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:58.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:58.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:58.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:58.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:58.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:59.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:26:59.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:26:59.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:26:59.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:26:59.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:26:59.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:00.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:00.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:00.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:00.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:00.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:00.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:01.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:01.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:01.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:01.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:01.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:01.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:02.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:02.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:02.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:02.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:02.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:02.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:03.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:03.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:03.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:03.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:03.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:03.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:04.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:04.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:04.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:04.139+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:04.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:04.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:05.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:05.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:05.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:05.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:05.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:05.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:06.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:06.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:06.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:06.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:06.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:06.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:07.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:07.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:07.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:07.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:07.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:07.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:08.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:08.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:08.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:08.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:08.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:08.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:09.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:09.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:09.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:09.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:09.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:09.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:10.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:10.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:10.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:10.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:10.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:10.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:11.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:11.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:11.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:11.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:11.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:11.699+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:12.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:12.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:12.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:12.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:12.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:12.727+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:13.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:13.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:13.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:13.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:13.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:13.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:14.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:14.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:14.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:14.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:14.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:14.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:15.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:15.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:15.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:15.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:15.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:15.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:16.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:16.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:16.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:16.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:16.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:16.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:17.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:17.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:17.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:17.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:17.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:17.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:18.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:18.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:18.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:18.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:18.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:18.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:19.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:19.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:19.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:19.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:19.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:19.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:20.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:20.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:20.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:20.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:20.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:20.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:21.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:21.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:21.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:21.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:21.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:21.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:22.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:22.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:22.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:22.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:22.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:22.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:23.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:23.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:23.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:23.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:23.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:23.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:24.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:24.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:24.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:24.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:24.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:24.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:25.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:25.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:25.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:25.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:25.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:25.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:26.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:26.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:26.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:26.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:26.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:26.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:27.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:27.034+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:27.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:27.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:27.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:27.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:28.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:28.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:28.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:28.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:28.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:28.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:29.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:28.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:29.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:29.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:29.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:29.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:29.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:29.978+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:30.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:30.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:30.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:30.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:30.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:30.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:31.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:31.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:31.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:31.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:31.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:31.966+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:32.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:32.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:32.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:32.834+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:33.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:32.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:33.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:33.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:33.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:33.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:34.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:34.006+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:34.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:34.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:34.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:34.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:35.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:35.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:35.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:35.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:35.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:35.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:36.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:36.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:36.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:36.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:36.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:36.834+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:37.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:37.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:37.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:37.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:37.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:37.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:38.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:38.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:38.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:38.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:38.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:38.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:39.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:39.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:39.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:39.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:39.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:39.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:40.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:40.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:40.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:40.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:40.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:40.882+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:41.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:41.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:41.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:41.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:41.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:41.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:42.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:42.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:42.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:42.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:42.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:42.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:43.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:43.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:43.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:43.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:43.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:43.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:44.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:44.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:44.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:44.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:44.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:44.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:45.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:45.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:45.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:45.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:45.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:45.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:46.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:46.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:46.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:46.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:46.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:46.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:47.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:47.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:47.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:47.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:47.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:47.834+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:48.067 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:48.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:48.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:48.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:48.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:48.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:49.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:49.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:49.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:49.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:49.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:49.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:50.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:50.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:50.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:50.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:50.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:50.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:51.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:51.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:51.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:51.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:51.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:51.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:52.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:52.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:52.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:52.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:52.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:52.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:53.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:53.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:53.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:53.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:53.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:53.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:54.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:54.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:54.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:54.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:54.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:54.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:55.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:55.058+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:55.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:55.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:55.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:55.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:56.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:56.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:56.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:56.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:56.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:56.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:57.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:57.002+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:57.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:57.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:57.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:57.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:57.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:57.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:58.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:58.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:58.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:58.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:58.955 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:58.950+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:59.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:27:59.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:27:59.907 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:27:59.902+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:27:59.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:27:59.902+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:00.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:00.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:00.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:00.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:00.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:00.942+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:01.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:01.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:01.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:01.862+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:01.921 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:01.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:02.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:02.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:02.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:02.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:02.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:02.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:03.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:03.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:03.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:03.830+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:03.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:03.954+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:04.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:04.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:04.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:04.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:04.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:04.962+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:05.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:05.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:05.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:05.822+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:05.999 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:05.994+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:06.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:06.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:06.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:06.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:07.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:07.010+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:07.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:07.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:07.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:07.854+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:08.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:08.026+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:08.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:08.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:08.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:08.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:09.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:09.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:09.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:09.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:09.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:09.813+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:10.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:10.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:10.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:10.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:10.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:10.833+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:11.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:11.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:11.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:11.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:11.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:11.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:12.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:12.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:12.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:12.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:12.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:12.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:13.075 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:13.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:13.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:13.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:13.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:13.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:14.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:14.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:14.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:14.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:14.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:14.929+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:15.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:15.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:15.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:15.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:15.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:15.921+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:16.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:16.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:16.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:16.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:16.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:16.905+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:17.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:17.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:17.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:17.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:17.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:17.885+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:18.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:18.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:18.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:18.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:18.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:18.905+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:19.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:19.121+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:19.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:19.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:19.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:19.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:20.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:20.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:20.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:20.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:20.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:20.909+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:21.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:21.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:21.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:21.389+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:21.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:21.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:22.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:22.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:22.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:22.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:22.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:22.861+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:23.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:23.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:23.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:23.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:23.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:23.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:24.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:24.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:24.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:24.393+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:24.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:24.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:25.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:25.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:25.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:25.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:25.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:25.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:26.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:26.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:26.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:26.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:26.845 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:26.841+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:27.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:27.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:27.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:27.373+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:27.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:27.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:28.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:28.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:28.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:28.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:28.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:28.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:29.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:29.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:29.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:29.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:29.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:29.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:30.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:30.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:30.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:30.393+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:30.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:30.877+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:31.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:31.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:31.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:31.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:31.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:31.921+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:32.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:32.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:32.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:32.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:32.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:32.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:33.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:33.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:33.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:33.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:33.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:33.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:34.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:34.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:34.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:34.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:34.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:34.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:35.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:35.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:35.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:35.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:36.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:36.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:36.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:36.193+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:36.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:36.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:37.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:37.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:37.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:37.205+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:37.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:37.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:38.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:38.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:38.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:38.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:38.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:38.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:39.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:39.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:39.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:39.177+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:39.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:39.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:40.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:40.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:40.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:40.161+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:40.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:40.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:41.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:41.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:41.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:41.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:41.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:41.325+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:42.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:42.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:42.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:42.197+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:42.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:42.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:42.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:42.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:43.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:43.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:43.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:43.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:43.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:43.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:44.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:44.229+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:44.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:44.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:44.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:44.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:45.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:45.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:45.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:45.321+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:45.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:45.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:46.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:46.213+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:46.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:46.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:47.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:47.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:47.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:47.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:47.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:47.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:48.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:48.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:48.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:48.221+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:48.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:48.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:49.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:49.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:49.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:49.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:49.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:49.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:49.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:49.973+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:50.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:50.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:50.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:50.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:51.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:51.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:51.281 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:51.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:51.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:51.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:51.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:51.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:52.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:52.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:52.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:52.321+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:52.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:52.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:53.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:53.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:53.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:53.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:54.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:54.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:54.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:54.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:54.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:54.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:54.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:54.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:55.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:55.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:55.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:55.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:55.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:55.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:56.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:56.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:56.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:56.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:56.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:56.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:57.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:57.180+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:57.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:57.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:58.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:58.012+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:58.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:58.204+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:58.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:58.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:58.971 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:58.968+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:28:59.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:28:59.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:28:59.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:28:59.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:00.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:28:59.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:00.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:00.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:00.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:00.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:01.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:01.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:01.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:01.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:01.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:01.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:02.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:02.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:02.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:02.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:02.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:02.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:02.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:02.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:03.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:03.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:03.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:03.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:03.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:03.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:04.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:04.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:04.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:04.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:04.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:04.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:05.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:05.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:05.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:05.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:05.911 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:05.908+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:06.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:06.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:06.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:06.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:06.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:06.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:07.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:07.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:07.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:07.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:07.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:07.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:08.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:08.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:08.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:08.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:08.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:08.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:09.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:09.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:09.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:09.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:09.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:09.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:10.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:10.140+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:10.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:10.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:10.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:10.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:11.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:11.192+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:11.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:11.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:11.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:11.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:12.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:12.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:12.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:12.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:12.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:12.796+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:13.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:13.200+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:13.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:13.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:13.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:13.764+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:14.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:14.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:14.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:14.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:14.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:14.792+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:15.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:15.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:15.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:15.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:15.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:15.768+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:16.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:16.256+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:16.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:16.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:16.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:16.760+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:17.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:17.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:17.385 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:17.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:17.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:17.792+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:18.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:18.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:18.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:18.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:18.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:18.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:19.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:19.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:19.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:19.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:19.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:19.828+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:20.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:20.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:20.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:20.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:20.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:20.868+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:21.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:21.200+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:21.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:21.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:21.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:21.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:22.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:22.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:22.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:22.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:22.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:22.804+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:23.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:23.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:23.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:23.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:23.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:23.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:24.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:24.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:24.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:24.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:24.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:24.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:25.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:25.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:25.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:25.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:25.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:25.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:26.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:26.244+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:26.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:26.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:26.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:26.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:27.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:27.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:27.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:27.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:27.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:27.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:28.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:28.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:28.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:28.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:28.844 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:28.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:29.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:29.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:29.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:29.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:29.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:29.836+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:30.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:30.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:30.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:30.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:30.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:30.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:31.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:31.312+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:31.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:31.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:31.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:31.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:32.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:32.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:32.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:32.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:32.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:32.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:33.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:33.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:33.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:33.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:33.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:33.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:34.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:34.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:34.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:34.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:34.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:34.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:35.286 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:35.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:35.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:35.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:35.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:35.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:36.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:36.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:36.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:36.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:36.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:36.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:37.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:37.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:37.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:37.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:37.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:37.868+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:38.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:38.252+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:38.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:38.300+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:38.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:38.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:39.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:39.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:39.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:39.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:39.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:39.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:40.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:40.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:40.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:40.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:40.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:40.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:41.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:41.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:41.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:41.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:41.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:41.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:42.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:42.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:42.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:42.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:42.905 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:42.899+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:43.249 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:43.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:43.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:43.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:43.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:43.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:44.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:44.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:44.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:44.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:44.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:44.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:45.281 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:45.275+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:45.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:45.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:45.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:45.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:46.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:46.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:46.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:46.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:46.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:46.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:47.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:47.239+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:47.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:47.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:47.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:47.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:48.273 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:48.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:48.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:48.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:49.000 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:48.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:49.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:49.247+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:49.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:49.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:50.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:50.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:50.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:50.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:50.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:50.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:51.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:51.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:51.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:51.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:51.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:51.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:52.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:52.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:52.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:52.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:52.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:52.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:53.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:53.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:53.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:53.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:53.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:53.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:54.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:54.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:54.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:54.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:54.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:54.303+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:55.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:55.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:55.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:55.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:55.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:55.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:56.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:56.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:56.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:56.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:56.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:56.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:57.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:57.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:57.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:57.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:57.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:57.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:58.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:57.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:58.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:58.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:58.371 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:58.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:58.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:29:58.967+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:29:59.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:29:59.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:29:59.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:29:59.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:00.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:00.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:00.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:00.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:00.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:00.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:01.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:01.055+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:01.304 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:01.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:01.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:01.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:02.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:02.091+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:02.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:02.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:02.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:02.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:03.059 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:03.055+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:03.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:03.263+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:03.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:03.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:04.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:04.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:04.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:04.263+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:04.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:04.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:05.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:05.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:05.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:05.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:05.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:05.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:06.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:06.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:06.210 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:06.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:06.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:06.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:07.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:07.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:07.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:07.223+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:07.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:07.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:07.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:07.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:08.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:08.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:08.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:08.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:08.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:08.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:09.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:09.247+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:09.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:09.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:09.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:09.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:10.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:10.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:10.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:10.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:10.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:10.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:11.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:11.187+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:11.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:11.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:11.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:11.879+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:12.150 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:12.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:12.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:12.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:12.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:12.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:13.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:13.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:13.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:13.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:13.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:13.815+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:14.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:14.175+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:14.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:14.363+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:14.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:14.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:15.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:15.191+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:15.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:15.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:15.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:15.839+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:16.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:16.183+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:16.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:16.331+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:16.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:16.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:17.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:17.191+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:17.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:17.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:17.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:17.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:18.186 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:18.183+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:18.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:18.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:18.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:18.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:19.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:19.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:19.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:19.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:19.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:19.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:20.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:20.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:20.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:20.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:20.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:20.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:21.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:21.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:21.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:21.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:21.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:21.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:22.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:22.279+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:22.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:22.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:22.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:22.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:23.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:23.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:23.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:23.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:23.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:23.731+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:24.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:24.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:24.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:24.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:24.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:24.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:25.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:25.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:25.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:25.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:25.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:25.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:26.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:26.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:26.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:26.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:26.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:26.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:27.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:27.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:27.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:27.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:27.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:27.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:28.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:28.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:28.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:28.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:28.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:28.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:29.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:29.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:29.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:29.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:29.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:29.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:30.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:30.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:30.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:30.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:30.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:30.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:31.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:31.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:31.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:31.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:31.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:31.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:32.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:32.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:32.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:32.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:32.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:32.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:33.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:33.286+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:33.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:33.366+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:33.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:33.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:34.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:34.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:34.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:34.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:34.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:34.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:35.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:35.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:35.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:35.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:35.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:35.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:36.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:36.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:36.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:36.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:36.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:36.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:37.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:37.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:37.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:37.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:37.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:37.566+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:38.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:38.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:38.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:38.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:38.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:38.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:39.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:39.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:39.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:39.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:39.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:39.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:40.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:40.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:40.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:40.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:40.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:40.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:41.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:41.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:41.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:41.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:41.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:41.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:42.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:42.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:42.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:42.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:42.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:42.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:43.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:43.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:43.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:43.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:43.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:43.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:44.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:44.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:44.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:44.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:44.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:44.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:45.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:45.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:45.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:45.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:45.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:45.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:46.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:46.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:46.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:46.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:46.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:46.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:47.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:47.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:47.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:47.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:47.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:47.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:48.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:48.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:48.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:48.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:48.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:48.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:49.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:49.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:49.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:49.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:49.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:49.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:50.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:50.342+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:50.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:50.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:50.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:50.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:51.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:51.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:51.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:51.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:51.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:51.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:52.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:52.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:52.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:52.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:52.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:52.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:53.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:53.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:53.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:53.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:53.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:53.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:54.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:54.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:54.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:54.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:54.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:54.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:55.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:55.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:55.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:55.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:55.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:55.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:56.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:56.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:56.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:56.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:56.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:56.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:57.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:57.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:57.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:57.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:57.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:57.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:58.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:58.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:58.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:58.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:58.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:58.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:59.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:30:59.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:30:59.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:30:59.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:30:59.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:30:59.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:00.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:00.354+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:00.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:00.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:00.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:00.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:01.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:01.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:01.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:01.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:01.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:01.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:02.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:02.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:02.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:02.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:02.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:02.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:03.394 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:03.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:03.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:03.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:03.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:03.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:04.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:04.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:04.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:04.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:04.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:04.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:05.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:05.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:05.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:05.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:05.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:05.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:06.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:06.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:06.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:06.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:06.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:06.798+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:07.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:07.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:07.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:07.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:07.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:07.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:08.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:08.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:08.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:08.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:08.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:08.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:09.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:09.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:09.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:09.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:09.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:09.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:10.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:10.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:10.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:10.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:10.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:10.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:11.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:11.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:11.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:11.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:11.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:11.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:12.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:12.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:12.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:12.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:12.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:12.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:13.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:13.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:13.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:13.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:13.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:13.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:14.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:14.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:14.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:14.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:14.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:14.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:15.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:15.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:15.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:15.437+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:15.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:15.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:16.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:16.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:16.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:16.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:16.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:16.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:17.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:17.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:17.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:17.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:17.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:17.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:18.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:18.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:18.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:18.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:18.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:18.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:19.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:19.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:19.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:19.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:19.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:19.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:20.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:20.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:20.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:20.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:20.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:20.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:21.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:21.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:21.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:21.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:21.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:21.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:22.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:22.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:22.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:22.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:22.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:22.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:23.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:23.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:23.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:23.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:23.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:23.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:24.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:24.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:24.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:24.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:24.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:24.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:25.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:25.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:25.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:25.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:25.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:25.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:26.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:26.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:26.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:26.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:26.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:26.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:27.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:27.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:27.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:27.629+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:27.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:27.681+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:28.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:28.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:28.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:28.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:28.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:28.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:29.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:29.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:29.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:29.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:29.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:29.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:30.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:30.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:30.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:30.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:30.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:30.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:31.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:31.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:31.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:31.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:31.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:31.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:32.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:32.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:32.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:32.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:32.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:32.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:33.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:33.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:33.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:33.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:33.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:33.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:34.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:34.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:34.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:34.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:34.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:34.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:35.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:35.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:35.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:35.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:35.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:35.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:36.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:36.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:36.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:36.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:36.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:36.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:37.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:37.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:37.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:37.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:37.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:37.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:38.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:38.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:38.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:38.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:38.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:38.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:39.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:39.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:39.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:39.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:39.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:39.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:40.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:40.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:40.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:40.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:40.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:40.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:41.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:41.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:41.701 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:41.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:41.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:41.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:42.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:42.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:42.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:42.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:42.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:42.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:43.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:43.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:43.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:43.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:43.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:43.853+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:44.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:44.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:44.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:44.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:44.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:44.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:45.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:45.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:45.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:45.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:45.878 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:45.877+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:46.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:46.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:46.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:46.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:46.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:46.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:47.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:47.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:47.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:47.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:47.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:47.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:48.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:48.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:48.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:48.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:48.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:48.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:49.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:49.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:49.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:49.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:49.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:49.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:50.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:50.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:50.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:50.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:50.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:50.901+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:51.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:51.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:51.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:51.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:51.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:51.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:52.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:52.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:52.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:52.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:52.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:52.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:53.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:53.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:53.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:53.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:53.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:53.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:54.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:54.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:54.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:54.873+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:54.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:54.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:55.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:55.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:55.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:55.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:55.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:55.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:56.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:56.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:56.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:56.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:56.949 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:56.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:57.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:57.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:57.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:57.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:57.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:57.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:58.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:58.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:58.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:58.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:58.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:58.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:59.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:31:59.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:31:59.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:31:59.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:31:59.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:31:59.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:00.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:00.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:00.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:00.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:01.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:00.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:01.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:01.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:01.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:01.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:01.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:01.976+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:02.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:02.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:02.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:02.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:03.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:03.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:03.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:03.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:03.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:03.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:04.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:04.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:04.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:04.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:04.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:04.780+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:05.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:05.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:05.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:05.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:05.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:05.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:06.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:06.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:06.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:06.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:06.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:06.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:07.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:07.008+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:07.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:07.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:07.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:07.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:08.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:08.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:08.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:08.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:08.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:08.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:09.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:09.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:09.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:09.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:09.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:09.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:10.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:10.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:10.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:10.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:10.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:10.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:11.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:11.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:11.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:11.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:11.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:11.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:12.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:12.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:12.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:12.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:12.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:12.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:13.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:13.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:13.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:13.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:13.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:13.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:14.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:14.008+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:14.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:14.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:14.934 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:14.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:15.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:15.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:15.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:15.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:15.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:15.924+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:16.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:15.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:16.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:16.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:16.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:16.944+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:16.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:16.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:17.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:17.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:17.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:17.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:17.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:17.988+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:18.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:18.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:18.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:18.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:19.026 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:19.024+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:19.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:19.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:19.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:19.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:20.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:20.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:20.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:20.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:20.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:20.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:21.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:21.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:21.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:21.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:21.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:21.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:22.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:22.020+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:22.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:22.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:22.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:22.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:23.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:23.036+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:23.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:23.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:23.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:23.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:24.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:24.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:24.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:24.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:24.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:24.888+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:25.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:25.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:25.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:25.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:25.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:25.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:26.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:26.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:26.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:26.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:26.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:26.896+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:27.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:27.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:27.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:27.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:27.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:27.936+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:28.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:28.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:28.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:28.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:28.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:28.896+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:29.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:29.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:29.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:29.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:29.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:29.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:30.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:30.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:30.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:30.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:30.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:30.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:31.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:31.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:31.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:31.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:31.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:31.896+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:32.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:32.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:32.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:32.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:32.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:32.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:33.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:33.140+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:33.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:33.624+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:33.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:33.972+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:34.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:34.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:34.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:34.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:34.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:34.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:35.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:35.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:35.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:35.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:35.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:35.972+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:36.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:36.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:36.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:36.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:36.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:36.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:37.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:37.140+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:37.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:37.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:37.912 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:37.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:38.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:38.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:38.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:38.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:38.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:38.860+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:39.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:39.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:39.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:39.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:39.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:39.892+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:40.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:40.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:40.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:40.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:40.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:40.888+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:41.102 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:41.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:41.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:41.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:41.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:41.880+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:42.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:42.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:42.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:42.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:42.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:42.851+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:43.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:43.123+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:43.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:43.595+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:43.906 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:43.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:44.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:44.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:44.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:44.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:44.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:44.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:45.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:45.087+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:45.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:45.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:45.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:45.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:46.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:46.099+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:46.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:46.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:46.895 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:46.891+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:47.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:47.135+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:47.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:47.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:47.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:47.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:48.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:48.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:48.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:48.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:48.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:48.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:49.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:49.119+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:49.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:49.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:49.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:49.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:50.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:50.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:50.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:50.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:50.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:50.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:51.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:51.035+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:51.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:51.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:51.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:51.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:52.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:52.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:52.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:52.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:52.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:52.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:53.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:53.035+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:53.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:53.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:53.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:53.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:54.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:53.999+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:54.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:54.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:54.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:54.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:54.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:54.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:55.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:55.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:55.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:55.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:55.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:55.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:56.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:56.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:56.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:56.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:56.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:56.991+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:57.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:57.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:57.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:57.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:58.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:58.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:58.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:58.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:58.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:58.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:59.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:32:59.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:32:59.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:32:59.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:32:59.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:32:59.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:00.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:00.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:00.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:00.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:00.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:00.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:01.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:01.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:01.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:01.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:02.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:02.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:02.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:02.103+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:02.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:02.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:03.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:03.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:03.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:03.135+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:03.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:03.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:03.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:03.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:04.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:04.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:04.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:04.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:04.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:04.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:05.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:05.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:05.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:05.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:05.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:05.979+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:06.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:06.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:06.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:06.515+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:07.019 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:07.015+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:07.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:07.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:07.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:07.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:08.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:08.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:08.135 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:08.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:08.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:08.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:09.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:09.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:09.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:09.167+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:09.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:09.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:10.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:10.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:10.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:10.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:10.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:10.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:11.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:11.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:11.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:11.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:11.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:11.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:12.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:12.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:12.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:12.163+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:12.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:12.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:13.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:13.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:13.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:13.175+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:13.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:13.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:14.033 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:14.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:14.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:14.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:14.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:14.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:15.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:15.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:15.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:15.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:15.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:15.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:16.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:16.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:16.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:16.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:16.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:16.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:17.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:17.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:17.249 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:17.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:17.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:17.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:18.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:17.999+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:18.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:18.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:18.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:18.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:19.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:19.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:19.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:19.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:19.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:19.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:20.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:20.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:20.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:20.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:20.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:20.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:21.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:21.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:21.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:21.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:21.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:21.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:22.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:22.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:22.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:22.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:22.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:22.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:23.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:23.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:23.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:23.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:23.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:23.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:24.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:24.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:24.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:24.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:24.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:24.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:25.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:25.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:25.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:25.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:25.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:25.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:26.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:26.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:26.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:26.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:26.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:26.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:26.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:26.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:27.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:27.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:27.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:27.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:27.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:27.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:28.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:28.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:28.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:28.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:29.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:28.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:29.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:29.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:29.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:29.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:30.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:30.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:30.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:30.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:30.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:30.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:31.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:31.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:31.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:31.306+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:31.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:31.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:32.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:32.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:32.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:32.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:32.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:32.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:33.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:33.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:33.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:33.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:33.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:33.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:34.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:34.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:34.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:34.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:34.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:34.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:35.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:35.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:35.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:35.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:35.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:35.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:36.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:36.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:36.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:36.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:36.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:36.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:37.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:37.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:37.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:37.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:37.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:37.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:38.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:38.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:38.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:38.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:38.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:38.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:39.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:39.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:39.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:39.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:39.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:39.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:40.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:40.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:40.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:40.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:40.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:40.518+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:41.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:41.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:41.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:41.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:41.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:41.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:42.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:42.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:42.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:42.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:42.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:42.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:43.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:43.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:43.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:43.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:43.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:43.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:44.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:44.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:44.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:44.294+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:44.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:44.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:45.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:45.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:45.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:45.294+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:45.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:45.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:46.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:46.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:46.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:46.282+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:46.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:46.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:47.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:47.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:47.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:47.286+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:47.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:47.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:48.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:48.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:48.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:48.290+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:48.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:48.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:49.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:49.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:49.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:49.330+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:49.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:49.338+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:50.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:50.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:50.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:50.354+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:50.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:50.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:51.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:51.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:51.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:51.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:51.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:51.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:52.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:52.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:52.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:52.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:52.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:52.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:53.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:53.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:53.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:53.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:53.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:53.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:54.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:54.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:54.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:54.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:54.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:54.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:55.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:55.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:55.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:55.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:55.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:55.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:56.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:56.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:56.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:56.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:56.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:56.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:57.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:57.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:57.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:57.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:57.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:57.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:58.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:58.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:58.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:58.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:58.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:58.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:33:59.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:33:59.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:59.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:33:59.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:33:59.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:33:59.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:00.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:00.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:00.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:00.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:00.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:00.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:01.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:01.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:01.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:01.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:01.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:01.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:02.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:02.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:02.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:02.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:02.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:02.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:03.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:03.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:03.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:03.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:03.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:03.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:04.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:04.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:04.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:04.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:04.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:04.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:05.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:05.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:05.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:05.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:05.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:05.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:06.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:06.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:06.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:06.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:06.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:06.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:07.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:07.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:07.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:07.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:07.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:07.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:08.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:08.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:08.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:08.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:08.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:08.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:09.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:09.030+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:09.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:09.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:09.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:09.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:10.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:10.018+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:10.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:10.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:10.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:10.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:11.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:11.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:11.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:11.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:11.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:11.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:12.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:12.106+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:12.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:12.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:12.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:12.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:13.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:13.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:13.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:13.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:13.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:13.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:14.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:14.081+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:14.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:14.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:14.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:14.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:15.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:15.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:15.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:15.673+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:15.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:15.837+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:16.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:16.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:16.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:16.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:16.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:16.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:17.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:17.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:17.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:17.693+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:17.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:17.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:18.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:18.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:18.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:18.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:18.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:18.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:19.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:19.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:19.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:19.769+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:19.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:19.885+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:20.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:20.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:20.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:20.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:20.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:20.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:21.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:21.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:21.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:21.765+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:21.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:21.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:22.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:22.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:22.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:22.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:22.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:22.837+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:23.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:23.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:23.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:23.841+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:23.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:23.881+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:24.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:24.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:24.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:24.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:24.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:24.905+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:25.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:25.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:25.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:25.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:25.945 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:25.941+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:26.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:26.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:26.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:26.909+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:26.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:26.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:27.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:27.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:27.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:27.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:27.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:27.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:28.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:28.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:28.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:28.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:29.003 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:29.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:29.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:29.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:29.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:29.977+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:29.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:29.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:30.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:30.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:30.969 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:30.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:31.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:31.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:31.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:31.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:31.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:31.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:31.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:31.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:32.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:32.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:32.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:32.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:33.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:33.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:33.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:33.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:33.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:33.941+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:33.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:33.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:34.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:34.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:34.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:34.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:35.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:35.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:35.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:35.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:35.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:35.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:35.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:35.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:36.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:36.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:36.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:36.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:37.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:37.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:37.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:37.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:37.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:37.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:38.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:38.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:38.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:38.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:38.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:38.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:38.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:38.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:39.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:39.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:39.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:39.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:40.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:40.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:40.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:40.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:40.977 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:40.973+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:40.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:40.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:41.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:41.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:42.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:42.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:42.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:42.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:42.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:42.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:42.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:42.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:43.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:43.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:43.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:43.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:43.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:43.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:44.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:44.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:44.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:44.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:44.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:44.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:45.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:45.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:45.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:45.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:45.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:45.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:46.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:46.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:46.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:46.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:46.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:46.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:47.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:47.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:47.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:47.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:47.978 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:47.977+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:48.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:48.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:48.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:48.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:48.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:48.981+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:49.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:49.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:49.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:49.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:49.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:49.969+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:50.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:50.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:50.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:50.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:50.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:50.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:51.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:51.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:51.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:51.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:52.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:52.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:52.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:52.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:52.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:52.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:53.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:53.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:53.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:53.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:53.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:53.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:54.005 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:54.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:54.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:54.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:54.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:54.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:55.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:55.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:55.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:55.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:55.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:55.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:55.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:55.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:56.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:56.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:56.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:56.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:56.929 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:56.925+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:57.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:57.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:57.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:57.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:57.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:57.885+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:58.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:58.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:58.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:58.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:58.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:58.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:59.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:34:59.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:34:59.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:34:59.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:34:59.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:34:59.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:00.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:00.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:00.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:00.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:00.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:00.944+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:01.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:01.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:01.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:01.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:01.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:01.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:02.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:02.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:02.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:02.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:02.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:02.880+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:03.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:03.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:03.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:03.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:03.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:03.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:04.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:04.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:04.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:04.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:04.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:04.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:05.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:05.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:05.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:05.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:05.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:05.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:06.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:06.156+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:06.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:06.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:06.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:06.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:07.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:07.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:07.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:07.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:07.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:07.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:08.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:08.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:08.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:08.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:08.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:08.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:09.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:09.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:09.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:09.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:09.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:09.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:10.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:10.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:10.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:10.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:10.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:10.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:11.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:11.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:11.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:11.244+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:11.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:11.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:12.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:12.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:12.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:12.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:12.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:12.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:13.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:13.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:13.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:13.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:13.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:13.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:14.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:14.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:14.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:14.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:14.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:14.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:15.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:15.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:15.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:15.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:15.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:15.864+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:16.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:16.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:16.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:16.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:16.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:16.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:17.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:17.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:17.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:17.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:17.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:17.820+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:18.139 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:18.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:18.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:18.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:18.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:18.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:19.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:19.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:19.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:19.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:19.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:19.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:20.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:20.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:20.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:20.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:20.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:20.836+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:21.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:21.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:21.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:21.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:21.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:21.820+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:22.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:22.148+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:22.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:22.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:22.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:22.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:23.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:23.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:23.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:23.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:23.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:23.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:24.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:24.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:24.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:24.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:24.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:24.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:25.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:25.140+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:25.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:25.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:25.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:25.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:26.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:26.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:26.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:26.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:26.897 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:26.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:27.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:27.108+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:27.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:27.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:27.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:27.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:28.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:28.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:28.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:28.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:28.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:28.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:29.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:29.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:29.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:29.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:29.884 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:29.880+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:30.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:30.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:30.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:30.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:30.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:30.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:31.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:31.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:31.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:31.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:31.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:31.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:32.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:32.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:32.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:32.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:32.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:32.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:33.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:33.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:33.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:33.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:33.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:33.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:34.056 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:34.052+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:34.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:34.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:34.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:34.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:35.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:35.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:35.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:35.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:35.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:35.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:36.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:36.112+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:36.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:36.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:36.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:36.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:37.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:37.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:37.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:37.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:37.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:37.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:38.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:38.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:38.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:38.292+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:38.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:38.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:39.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:39.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:39.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:39.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:39.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:39.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:40.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:40.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:40.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:40.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:40.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:40.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:41.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:41.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:41.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:41.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:41.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:41.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:42.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:42.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:42.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:42.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:42.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:42.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:43.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:43.108+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:43.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:43.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:43.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:43.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:44.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:44.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:44.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:44.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:44.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:44.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:45.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:45.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:45.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:45.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:45.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:45.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:46.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:46.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:46.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:46.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:46.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:46.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:47.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:47.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:47.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:47.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:47.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:47.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:48.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:48.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:48.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:48.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:48.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:48.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:49.063 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:49.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:49.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:49.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:49.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:49.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:50.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:50.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:50.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:50.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:50.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:50.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:51.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:51.127+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:51.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:51.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:51.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:51.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:52.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:52.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:52.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:52.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:52.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:52.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:53.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:53.175+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:53.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:53.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:53.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:53.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:54.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:54.127+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:54.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:54.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:54.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:54.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:55.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:55.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:55.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:55.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:55.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:55.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:56.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:56.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:56.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:56.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:56.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:56.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:57.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:57.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:57.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:57.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:57.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:57.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:58.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:58.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:58.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:58.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:58.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:58.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:59.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:35:59.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:35:59.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:35:59.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:35:59.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:35:59.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:00.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:00.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:00.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:00.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:00.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:00.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:01.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:01.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:01.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:01.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:01.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:01.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:02.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:02.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:02.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:02.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:02.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:02.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:03.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:03.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:03.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:03.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:03.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:03.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:04.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:04.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:04.227 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:04.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:04.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:04.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:05.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:05.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:05.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:05.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:05.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:05.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:06.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:06.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:06.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:06.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:06.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:06.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:07.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:07.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:07.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:07.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:07.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:07.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:08.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:08.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:08.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:08.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:08.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:08.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:09.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:09.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:09.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:09.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:09.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:09.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:10.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:10.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:10.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:10.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:10.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:10.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:11.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:11.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:11.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:11.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:11.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:11.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:12.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:12.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:12.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:12.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:12.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:12.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:13.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:13.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:13.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:13.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:13.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:13.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:14.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:14.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:14.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:14.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:14.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:14.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:15.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:15.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:15.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:15.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:15.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:15.651+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:16.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:16.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:16.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:16.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:16.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:16.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:17.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:17.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:17.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:17.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:17.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:17.651+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:18.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:18.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:18.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:18.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:18.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:18.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:19.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:19.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:19.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:19.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:19.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:19.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:20.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:20.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:20.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:20.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:20.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:20.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:21.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:21.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:21.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:21.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:21.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:21.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:22.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:22.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:22.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:22.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:22.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:22.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:23.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:23.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:23.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:23.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:23.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:23.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:24.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:24.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:24.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:24.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:24.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:24.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:25.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:25.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:25.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:25.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:25.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:25.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:26.254 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:26.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:26.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:26.283+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:26.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:26.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:27.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:27.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:27.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:27.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:27.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:27.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:28.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:28.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:28.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:28.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:28.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:28.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:29.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:29.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:29.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:29.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:29.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:29.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:30.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:30.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:30.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:30.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:30.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:30.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:31.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:31.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:31.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:31.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:31.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:31.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:32.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:32.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:32.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:32.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:32.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:32.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:33.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:33.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:33.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:33.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:33.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:33.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:34.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:34.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:34.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:34.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:34.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:34.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:35.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:35.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:35.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:35.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:35.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:35.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:36.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:36.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:36.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:36.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:36.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:36.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:37.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:37.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:37.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:37.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:37.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:37.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:38.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:38.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:38.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:38.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:38.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:38.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:39.223 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:39.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:39.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:39.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:39.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:39.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:40.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:40.174+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:40.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:40.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:40.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:40.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:41.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:41.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:41.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:41.314+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:41.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:41.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:42.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:42.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:42.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:42.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:42.701 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:42.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:43.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:43.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:43.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:43.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:43.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:43.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:44.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:44.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:44.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:44.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:44.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:44.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:45.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:45.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:45.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:45.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:45.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:45.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:46.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:46.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:46.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:46.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:46.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:46.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:47.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:47.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:47.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:47.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:47.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:47.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:48.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:48.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:48.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:48.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:48.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:48.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:49.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:49.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:49.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:49.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:49.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:49.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:50.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:50.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:50.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:50.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:50.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:50.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:51.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:51.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:51.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:51.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:51.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:51.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:52.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:52.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:52.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:52.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:52.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:52.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:53.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:53.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:53.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:53.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:53.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:53.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:54.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:54.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:54.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:54.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:54.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:54.798+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:55.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:55.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 7 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:55.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:55.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:55.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:55.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:56.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:56.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:56.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:56.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:56.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:56.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:57.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:57.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:57.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:57.286+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:57.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:57.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:58.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:58.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:58.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:58.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:58.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:58.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:59.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:36:59.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:36:59.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:36:59.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:36:59.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:36:59.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:00.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:00.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:00.325 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:00.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:00.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:00.906+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:01.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:01.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:01.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:01.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:01.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:01.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:02.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:02.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:02.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:02.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:02.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:02.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:03.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:03.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:03.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:03.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:03.884 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:03.878+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:04.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:04.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:04.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:04.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:04.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:04.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:05.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:05.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:05.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:05.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:05.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:05.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:06.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:06.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:06.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:06.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:06.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:06.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:07.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:07.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:07.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:07.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:07.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:07.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:08.139 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:08.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:08.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:08.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:08.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:08.910+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:09.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:09.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:09.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:09.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:09.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:09.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:10.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:10.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:10.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:10.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:10.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:10.954+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:11.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:11.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:11.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:11.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:11.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:11.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:12.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:12.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:12.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:12.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:12.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:12.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:13.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:13.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:13.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:13.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:13.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:13.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:14.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:14.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:14.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:14.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:14.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:14.922+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:15.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:15.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:15.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:15.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:15.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:15.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:16.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:16.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:16.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:16.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:16.905 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:16.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:17.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:17.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:17.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:17.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:17.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:17.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:18.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:18.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:18.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:18.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:18.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:18.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:19.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:19.177+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:19.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:19.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:19.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:19.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:20.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:20.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:20.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:20.361+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:20.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:20.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:21.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:21.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:21.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:21.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:22.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:22.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:22.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:22.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:22.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:22.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:23.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:23.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:23.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:23.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:23.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:23.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:24.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:24.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:24.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:24.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:24.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:24.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:24.976 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:24.969+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:25.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:25.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:25.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:25.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:25.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:25.981+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:26.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:26.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:26.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:26.289+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:27.033 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:27.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:27.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:27.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:27.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:27.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:28.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:28.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:28.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:28.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:28.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:28.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:29.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:29.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:29.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:29.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:29.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:29.377+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:30.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:30.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:30.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:30.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:30.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:30.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:31.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:31.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:31.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:31.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:31.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:31.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:32.027 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:32.025+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:32.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:32.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:32.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:32.449+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:33.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:33.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:33.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:33.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:33.449 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:33.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:34.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:34.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:34.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:34.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:34.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:34.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:35.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:35.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:35.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:35.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:35.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:35.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:36.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:36.013+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:36.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:36.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:36.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:36.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:37.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:37.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:37.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:37.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:37.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:37.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:38.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:38.057+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:38.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:38.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:38.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:38.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:39.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:39.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:39.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:39.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:39.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:39.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:40.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:40.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:40.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:40.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:40.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:40.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:41.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:41.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:41.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:41.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:41.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:41.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:42.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:42.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:42.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:42.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:42.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:42.449+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:43.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:43.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:43.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:43.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:43.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:43.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:44.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:44.173+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:44.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:44.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:44.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:44.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:45.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:45.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:45.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:45.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:45.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:45.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:46.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:46.221+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:46.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:46.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:46.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:46.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:47.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:47.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:47.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:47.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:47.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:47.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:48.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:48.149+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:48.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:48.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:48.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:48.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:49.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:49.185+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:49.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:49.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:49.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:49.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:50.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:50.185+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:50.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:50.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:50.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:50.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:51.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:51.169+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:51.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:51.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:51.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:51.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:52.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:52.133+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:52.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:52.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:52.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:52.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:53.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:53.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:53.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:53.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:53.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:53.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:54.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:54.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:54.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:54.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:54.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:54.361+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:55.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:55.125+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:55.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:55.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:55.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:55.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:56.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:56.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:56.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:56.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:56.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:56.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:57.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:57.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:57.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:57.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:57.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:57.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:58.008 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:58.005+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:58.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:58.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:58.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:58.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:59.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:59.017+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:59.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:37:59.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:37:59.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:37:59.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:37:59.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:37:59.969+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:00.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:00.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:00.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:00.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:00.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:00.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:01.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:01.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:01.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:01.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:01.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:01.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:02.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:02.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:02.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:02.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:02.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:02.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:03.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:03.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:03.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:03.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:03.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:03.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:04.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:04.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:04.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:04.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:04.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:04.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:05.362 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:05.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:05.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:05.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:05.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:05.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:06.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:06.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:06.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:06.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:06.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:06.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:07.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:07.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:07.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:07.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:07.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:07.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:08.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:08.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:08.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:08.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:08.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:08.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:09.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:09.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:09.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:09.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:09.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:09.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:10.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:10.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:10.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:10.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:10.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:10.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:11.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:11.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:11.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:11.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:11.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:11.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:12.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:12.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:12.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:12.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:12.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:12.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:13.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:13.320+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:13.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:13.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:13.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:13.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:14.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:14.280+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:14.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:14.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:14.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:14.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:15.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:15.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:15.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:15.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:15.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:15.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:16.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:16.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:16.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:16.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:16.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:16.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:17.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:17.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:17.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:17.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:17.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:17.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:18.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:18.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:18.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:18.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:18.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:18.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:19.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:19.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:19.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:19.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:19.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:19.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:20.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:20.284+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:20.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:20.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:20.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:20.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:21.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:21.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:21.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:21.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:21.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:21.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:22.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:22.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:22.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:22.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:22.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:22.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:23.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:23.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:23.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:23.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:23.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:23.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:24.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:24.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:24.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:24.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:24.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:24.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:25.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:25.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:25.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:25.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:25.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:25.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:26.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:26.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:26.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:26.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:26.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:26.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:27.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:27.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:27.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:27.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:27.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:27.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:28.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:28.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:28.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:28.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:28.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:28.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:29.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:29.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:29.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:29.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:29.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:29.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:30.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:30.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:30.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:30.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:30.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:30.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:31.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:31.268+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:31.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:31.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:31.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:31.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:32.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:32.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:32.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:32.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:32.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:32.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:33.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:33.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:33.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:33.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:33.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:33.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:34.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:34.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:34.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:34.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:34.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:34.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:35.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:35.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:35.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:35.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:35.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:35.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:36.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:36.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:36.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:36.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:36.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:36.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:37.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:37.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:37.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:37.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:37.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:37.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:38.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:38.300+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:38.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:38.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:38.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:38.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:39.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:39.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:39.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:39.328+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:39.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:39.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:40.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:40.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:40.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:40.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:40.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:40.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:41.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:41.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:41.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:41.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:41.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:41.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:42.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:42.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:42.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:42.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:42.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:42.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:43.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:43.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:43.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:43.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:43.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:43.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:44.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:44.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:44.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:44.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:44.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:44.780+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:45.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:45.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:45.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:45.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:45.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:45.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:46.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:46.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:46.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:46.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:46.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:46.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:47.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:47.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:47.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:47.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:47.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:47.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:48.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:48.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:48.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:48.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:48.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:48.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:49.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:49.439+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:49.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:49.499+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:49.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:49.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:50.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:50.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:50.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:50.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:50.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:50.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:51.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:51.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:51.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:51.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:51.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:51.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:52.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:52.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:52.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:52.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:52.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:52.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:53.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:53.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:53.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:53.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:53.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:53.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:54.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:54.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:54.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:54.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:54.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:54.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:55.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:55.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:55.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:55.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:55.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:55.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:56.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:56.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:56.557 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:56.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:56.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:56.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:57.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:57.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:57.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:57.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:57.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:57.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:58.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:58.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:58.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:58.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:58.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:58.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:59.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:38:59.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:38:59.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:38:59.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:38:59.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:38:59.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:00.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:00.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:00.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:00.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:00.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:00.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:01.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:01.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:01.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:01.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:01.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:01.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:02.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:02.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:02.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:02.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:02.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:02.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:03.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:03.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:03.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:03.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:03.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:03.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:04.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:04.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:04.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:04.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:04.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:04.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:05.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:05.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:05.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:05.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:05.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:05.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:06.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:06.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:06.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:06.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:06.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:06.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:07.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:07.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:07.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:07.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:07.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:07.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:08.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:08.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:08.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:08.423+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:08.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:08.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:09.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:09.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:09.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:09.467+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:09.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:09.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:10.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:10.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:10.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:10.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:10.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:10.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:11.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:11.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:11.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:11.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:11.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:11.727+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:12.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:12.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:12.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:12.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:12.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:12.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:13.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:13.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:13.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:13.471+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:13.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:13.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:14.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:14.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:14.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:14.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:14.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:14.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:15.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:15.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:15.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:15.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:15.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:15.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:16.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:16.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:16.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:16.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:16.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:16.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:17.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:17.367+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:17.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:17.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:17.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:17.587+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:18.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:18.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:18.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:18.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:18.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:18.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:19.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:19.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:19.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:19.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:19.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:19.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:20.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:20.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:20.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:20.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:20.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:20.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:21.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:21.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:21.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:21.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:21.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:21.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:22.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:22.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:22.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:22.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:22.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:22.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:23.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:23.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:23.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:23.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:23.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:23.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:24.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:24.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:24.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:24.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:24.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:24.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:25.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:25.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:25.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:25.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:25.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:25.607+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:26.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:26.367+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:26.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:26.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:26.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:26.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:27.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:27.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:27.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:27.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:27.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:27.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:28.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:28.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:28.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:28.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:28.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:28.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:29.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:29.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:29.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:29.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:29.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:29.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:30.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:30.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:30.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:30.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:30.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:30.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:31.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:31.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:31.557 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:31.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:31.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:31.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:32.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:32.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:32.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:32.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:32.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:32.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:33.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:33.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:33.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:33.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:33.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:33.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:34.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:34.278+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:34.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:34.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:34.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:34.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:35.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:35.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:35.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:35.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:35.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:35.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:36.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:36.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:36.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:36.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:36.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:36.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:37.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:37.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:37.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:37.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:37.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:37.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:38.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:38.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:38.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:38.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:38.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:38.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:39.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:39.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:39.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:39.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:39.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:39.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:40.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:40.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:40.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:40.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:40.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:40.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:41.135 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:41.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:41.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:41.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:41.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:41.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:42.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:42.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:42.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:42.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:42.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:42.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:43.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:43.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:43.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:43.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:43.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:43.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:44.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:44.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:44.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:44.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:44.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:44.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:45.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:45.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:45.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:45.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:45.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:45.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:46.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:46.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:46.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:46.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:46.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:46.570+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:47.138 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:47.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:47.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:47.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:47.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:47.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:48.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:48.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:48.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:48.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:48.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:48.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:49.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:49.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:49.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:49.506+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:49.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:49.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:50.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:50.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:50.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:50.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:50.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:50.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:51.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:51.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:51.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:51.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:51.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:51.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:52.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:52.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:52.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:52.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:52.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:52.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:53.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:53.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:53.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:53.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:53.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:53.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:54.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:54.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:54.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:54.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:54.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:54.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:55.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:55.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:55.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:55.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:55.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:55.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:56.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:56.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:56.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:56.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:56.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:56.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:57.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:57.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:57.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:57.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:57.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:57.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:58.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:58.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:58.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:58.422+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:58.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:58.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:59.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:39:59.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:39:59.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:39:59.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:39:59.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:39:59.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:00.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:00.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:00.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:00.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:00.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:00.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:01.254 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:01.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:01.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:01.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:01.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:01.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:02.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:02.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:02.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:02.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:02.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:02.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:03.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:03.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:03.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:03.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:03.693 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:03.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:04.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:04.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:04.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:04.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:04.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:04.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:05.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:05.210+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:05.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:05.394+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:05.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:05.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:06.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:06.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:06.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:06.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:06.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:06.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:07.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:07.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:07.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:07.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:07.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:07.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:08.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:08.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:08.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:08.382+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:08.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:08.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:09.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:09.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:09.345 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:09.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:09.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:09.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:10.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:10.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:10.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:10.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:10.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:10.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:11.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:11.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:11.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:11.346+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:11.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:11.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:12.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:12.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:12.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:12.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:12.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:12.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:13.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:13.222+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:13.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:13.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:13.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:13.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:14.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:14.222+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:14.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:14.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:14.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:14.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:15.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:15.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:15.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:15.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:15.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:15.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:16.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:16.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:16.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:16.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:16.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:16.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:17.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:17.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:17.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:17.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:17.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:17.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:18.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:18.178+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:18.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:18.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:18.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:18.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:19.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:19.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:19.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:19.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:19.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:19.814+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:20.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:20.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:20.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:20.509+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:20.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:20.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:21.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:21.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:21.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:21.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:21.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:21.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:22.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:22.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:22.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:22.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:22.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:22.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:23.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:23.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:23.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:23.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:23.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:23.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:24.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:24.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:24.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:24.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:24.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:24.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:25.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:25.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:25.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:25.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:25.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:25.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:26.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:26.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:26.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:26.629+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:26.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:26.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:27.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:27.173+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:27.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:27.609+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:27.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:27.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:28.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:28.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:28.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:28.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:28.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:28.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:29.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:29.177+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:29.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:29.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:29.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:29.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:30.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:30.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:30.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:30.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:30.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:30.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:31.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:31.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:31.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:31.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:31.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:31.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:32.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:32.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:32.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:32.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:32.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:32.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:33.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:33.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:33.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:33.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:33.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:33.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:34.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:34.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:34.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:34.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:34.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:34.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:35.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:35.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:35.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:35.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:35.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:35.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:36.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:36.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:36.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:36.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:36.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:36.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:37.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:37.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:37.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:37.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:37.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:37.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:38.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:38.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:38.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:38.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:38.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:38.745+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:39.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:39.205+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:39.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:39.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:39.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:39.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:40.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:40.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:40.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:40.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:40.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:40.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:41.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:41.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:41.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:41.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:41.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:41.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:42.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:42.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:42.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:42.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:42.787 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:42.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:43.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:43.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:43.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:43.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:43.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:43.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:44.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:44.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:44.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:44.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:44.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:44.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:45.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:45.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:45.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:45.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:45.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:45.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:46.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:46.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:46.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:46.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:46.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:46.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:47.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:47.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:47.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:47.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:47.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:47.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:48.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:48.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:48.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:48.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:48.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:48.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:49.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:49.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:49.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:49.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:49.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:49.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:50.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:50.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:50.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:50.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:50.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:50.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:51.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:51.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:51.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:51.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:51.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:51.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:52.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:52.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:52.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:52.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:52.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:52.717+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:53.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:53.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:53.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:53.681+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:53.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:53.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:54.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:54.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:54.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:54.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:54.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:54.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:55.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:55.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:55.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:55.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:55.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:55.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:56.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:56.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:56.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:56.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:56.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:56.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:57.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:57.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:57.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:57.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:57.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:57.733+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:58.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:58.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:58.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:58.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:58.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:58.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:59.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:40:59.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:40:59.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:40:59.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:40:59.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:40:59.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:00.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:00.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:00.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:00.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:00.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:00.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:01.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:01.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:01.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:01.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:01.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:01.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:02.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:02.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:02.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:02.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:02.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:02.841+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:03.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:03.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:03.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:03.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:03.896 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:03.893+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:04.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:04.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:04.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:04.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:04.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:04.889+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:05.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:05.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:05.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:05.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:05.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:05.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:06.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:06.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:06.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:06.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:06.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:06.864+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:07.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:07.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:07.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:07.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:07.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:07.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:08.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:08.244+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:08.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:08.724+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:08.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:08.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:09.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:09.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:09.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:09.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:09.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:09.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:10.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:10.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:10.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:10.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:10.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:10.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:11.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:11.268+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:11.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:11.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:11.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:11.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:12.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:12.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:12.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:12.824+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:12.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:12.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:13.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:13.328+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:13.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:13.860+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:13.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:13.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:14.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:14.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:14.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:14.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:14.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:14.852+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:15.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:15.356+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:15.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:15.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:15.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:15.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:16.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:16.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:16.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:16.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:16.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:16.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:17.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:17.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:17.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:17.800+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:17.909 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:17.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:18.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:18.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:18.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:18.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:18.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:18.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:19.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:19.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:19.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:19.820+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:19.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:19.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:20.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:20.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:20.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:20.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:20.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:20.860+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:21.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:21.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:21.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:21.836+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:21.845 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:21.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:22.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:22.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:22.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:22.812+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:22.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:22.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:23.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:23.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:23.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:23.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:23.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:23.836+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:24.485 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:24.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:24.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:24.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:24.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:24.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:25.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:25.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:25.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:25.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:25.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:25.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:26.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:26.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:26.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:26.864+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:26.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:26.892+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:27.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:27.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:27.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:27.880+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:27.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:27.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:28.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:28.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:28.928 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:28.924+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:28.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:28.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:29.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:29.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:29.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:29.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:29.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:29.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:30.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:30.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:30.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:30.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:31.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:31.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:31.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:31.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:31.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:31.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:32.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:32.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:32.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:32.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:32.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:32.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:33.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:33.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:33.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:33.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:33.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:33.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:34.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:34.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:34.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:34.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:34.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:34.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:35.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:35.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:35.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:35.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:35.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:35.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:36.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:36.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:36.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:36.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:36.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:36.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:37.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:37.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:37.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:37.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:37.919 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:37.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:38.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:38.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:38.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:38.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:38.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:38.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:39.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:39.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:39.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:39.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:39.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:39.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:40.063 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:40.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:40.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:40.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:40.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:40.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:41.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:41.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:41.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:41.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:41.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:41.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:42.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:42.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:42.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:42.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:42.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:42.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:43.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:43.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:43.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:43.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:43.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:43.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:44.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:44.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:44.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:44.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:44.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:44.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:45.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:45.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:45.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:45.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:45.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:45.860+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:46.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:46.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:46.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:46.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:46.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:46.880+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:47.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:47.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:47.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:47.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:47.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:47.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:48.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:48.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:48.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:48.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:48.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:48.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:49.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:49.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:49.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:49.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:49.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:49.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:49.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:49.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:50.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:50.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:50.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:50.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:50.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:50.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:51.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:51.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:51.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:51.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:52.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:52.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:52.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:52.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:52.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:52.927+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:53.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:52.999+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:53.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:53.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:53.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:53.963+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:54.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:54.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:54.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:54.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:54.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:54.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:55.010 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:55.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:55.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:55.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:55.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:55.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:56.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:56.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:56.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:56.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:57.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:57.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:57.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:57.095+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:57.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:57.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:58.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:57.999+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:58.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:58.083+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:58.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:58.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:41:58.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:58.971+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:59.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:41:59.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:41:59.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:41:59.583+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:00.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:41:59.995+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:00.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:00.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:00.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:00.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:01.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:01.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:01.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:01.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:01.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:01.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:02.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:02.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:02.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:02.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:02.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:02.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:03.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:03.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:03.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:03.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:03.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:03.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:04.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:04.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:04.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:04.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:04.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:04.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:05.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:05.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:05.208 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:05.203+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:05.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:05.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:06.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:06.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:06.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:06.183+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:06.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:06.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:07.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:07.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:07.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:07.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:07.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:07.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:08.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:08.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:08.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:08.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:08.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:08.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:09.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:09.015+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:09.210 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:09.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:09.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:09.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:10.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:10.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:10.235 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:10.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:10.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:10.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:11.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:11.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:11.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:11.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:11.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:11.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:11.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:11.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:12.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:12.179+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:12.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:12.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:12.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:12.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:13.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:13.139+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:13.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:13.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:13.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:13.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:14.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:14.099+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:14.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:14.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:14.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:14.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:15.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:15.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:15.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:15.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:15.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:15.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:16.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:16.103+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:16.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:16.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:16.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:16.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:17.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:17.135+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:17.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:17.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:17.938 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:17.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:18.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:18.179+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:18.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:18.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:18.935 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:18.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:19.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:19.143+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:19.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:19.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:19.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:19.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:20.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:20.167+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:20.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:20.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:20.957 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:20.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:21.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:21.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:21.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:21.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:21.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:21.971+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:22.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:22.123+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:22.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:22.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:23.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:22.999+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:23.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:23.143+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:23.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:23.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:24.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:24.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:24.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:24.191+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:24.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:24.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:25.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:25.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:25.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:25.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:25.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:25.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:26.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:26.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:26.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:26.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:26.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:26.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:27.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:27.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:27.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:27.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:27.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:27.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:28.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:28.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:28.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:28.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:28.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:28.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:29.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:29.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:29.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:29.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:29.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:29.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:30.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:30.047+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:30.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:30.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:30.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:30.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:31.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:31.011+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:31.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:31.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:31.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:31.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:32.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:32.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:32.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:32.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:32.344 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:32.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:33.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:33.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:33.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:33.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:33.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:33.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:34.023 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:34.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:34.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:34.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:34.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:34.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:34.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:34.995+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:35.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:35.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:35.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:35.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:35.972 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:35.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:36.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:36.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:36.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:36.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:36.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:36.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:37.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:37.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:37.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:37.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:37.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:37.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:38.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:38.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:38.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:38.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:38.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:38.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:39.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:39.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:39.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:39.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:40.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:40.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:40.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:40.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:40.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:40.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:40.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:40.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:41.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:41.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:41.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:41.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:42.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:42.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:42.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:42.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:42.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:42.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:42.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:42.986+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:43.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:43.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:43.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:43.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:43.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:43.986+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:44.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:44.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:44.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:44.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:44.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:44.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:45.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:45.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:45.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:45.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:45.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:45.978+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:46.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:46.350+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:46.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:46.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:46.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:46.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:47.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:47.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:47.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:47.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:47.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:47.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:48.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:48.402+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:48.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:48.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:48.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:48.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:49.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:49.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:49.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:49.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:49.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:49.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:50.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:50.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:50.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:50.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:50.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:50.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:51.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:51.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:51.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:51.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:51.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:51.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:52.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:52.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:52.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:52.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:52.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:52.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:53.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:53.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:53.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:53.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:53.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:53.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:54.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:54.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:54.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:54.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:54.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:54.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:55.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:55.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:55.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:55.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:55.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:55.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:56.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:56.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:56.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:56.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:56.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:56.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:57.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:57.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:57.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:57.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:57.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:57.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:58.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:58.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:58.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:58.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:58.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:58.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:59.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:42:59.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:42:59.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:42:59.470+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:42:59.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:42:59.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:00.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:00.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:00.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:00.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:00.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:00.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:01.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:01.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:01.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:01.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:01.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:01.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:02.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:02.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:02.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:02.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:02.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:02.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:03.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:03.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:03.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:03.518+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:03.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:03.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:04.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:04.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:04.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:04.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:04.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:04.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:05.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:05.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:05.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:05.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:05.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:05.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:06.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:06.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:06.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:06.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:06.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:06.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:07.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:07.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:07.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:07.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:07.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:07.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:08.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:08.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:08.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:08.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:08.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:08.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:09.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:09.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:09.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:09.550+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:09.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:09.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:10.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:10.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:10.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:10.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:10.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:10.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:11.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:11.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:11.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:11.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:11.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:11.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:12.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:12.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:12.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:12.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:12.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:12.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:13.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:13.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:13.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:13.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:13.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:13.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:14.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:14.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:14.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:14.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:14.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:14.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:15.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:15.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:15.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:15.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:15.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:15.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:16.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:16.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:16.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:16.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:16.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:16.706+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:17.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:17.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:17.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:17.550+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:17.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:17.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:18.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:18.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:18.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:18.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:18.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:18.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:19.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:19.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:19.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:19.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:19.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:19.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:20.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:20.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:20.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:20.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:20.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:20.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:21.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:21.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:21.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:21.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:21.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:21.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:22.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:22.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:22.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:22.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:22.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:22.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:23.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:23.409+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:23.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:23.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:23.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:23.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:24.377 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:24.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:24.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:24.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:24.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:24.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:25.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:25.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:25.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:25.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:25.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:25.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:26.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:26.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:26.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:26.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:26.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:26.797+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:27.344 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:27.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:27.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:27.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:27.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:27.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:28.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:28.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:28.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:28.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:28.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:28.817+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:29.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:29.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:29.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:29.557+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:29.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:29.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:30.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:30.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:30.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:30.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:30.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:30.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:31.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:31.241+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:31.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:31.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:31.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:31.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:32.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:32.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:32.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:32.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:32.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:32.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:33.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:33.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:33.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:33.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:33.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:33.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:34.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:34.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:34.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:34.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:34.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:34.753+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:35.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:35.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:35.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:35.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:35.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:35.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:36.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:36.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:36.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:36.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:36.776 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:36.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:37.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:37.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:37.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:37.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:37.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:37.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:38.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:38.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:38.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:38.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:38.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:38.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:39.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:39.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:39.488 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:39.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:39.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:39.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:40.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:40.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:40.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:40.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:40.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:40.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:41.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:41.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:41.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:41.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:41.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:41.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:42.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:42.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:42.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:42.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:42.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:42.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:43.234 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:43.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:43.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:43.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:43.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:43.813+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:44.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:44.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:44.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:44.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:44.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:44.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:45.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:45.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:45.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:45.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:45.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:45.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:46.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:46.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:46.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:46.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:46.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:46.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:47.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:47.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:47.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:47.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:47.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:47.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:48.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:48.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:48.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:48.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:48.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:48.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:49.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:49.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:49.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:49.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:49.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:49.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:50.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:50.221+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:50.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:50.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:50.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:50.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:51.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:51.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:51.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:51.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:51.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:51.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:52.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:52.225+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:52.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:52.745+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:52.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:52.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:53.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:53.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:53.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:53.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:53.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:53.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:54.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:54.229+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:54.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:54.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:54.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:54.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:55.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:55.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:55.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:55.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:55.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:55.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:56.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:56.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:56.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:56.733+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:56.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:56.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:57.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:57.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:57.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:57.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:57.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:57.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:58.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:58.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:58.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:58.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:58.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:58.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:59.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:43:59.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:43:59.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:43:59.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:43:59.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:43:59.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:00.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:00.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:00.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:00.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:00.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:00.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:01.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:01.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:01.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:01.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:01.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:01.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:02.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:02.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:02.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:02.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:02.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:02.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:03.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:03.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:03.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:03.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:04.023 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:04.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:04.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:04.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:04.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:04.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:05.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:05.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:05.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:05.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:05.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:05.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:06.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:06.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:06.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:06.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:06.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:06.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:07.015 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:07.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:07.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:07.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:07.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:07.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:07.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:07.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:08.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:08.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:08.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:08.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:08.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:08.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:09.254 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:09.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:09.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:09.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:09.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:09.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:10.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:10.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:10.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:10.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:10.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:10.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:11.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:11.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:11.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:11.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:12.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:12.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:12.221 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:12.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:12.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:12.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:12.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:12.960+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:13.185 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:13.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:13.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:13.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:14.008 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:14.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:14.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:14.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:14.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:14.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:15.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:15.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:15.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:15.128+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:15.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:15.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:16.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:16.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:16.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:16.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:16.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:16.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:17.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:17.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:17.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:17.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:17.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:17.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:18.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:18.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:18.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:18.088+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:18.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:18.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:19.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:19.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:19.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:19.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:19.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:19.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:20.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:20.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:20.123 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:20.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:20.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:20.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:21.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:21.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:21.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:21.108+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:21.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:21.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:22.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:22.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:22.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:22.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:22.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:22.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:23.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:23.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:23.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:23.112+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:23.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:23.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:24.076 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:24.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:24.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:24.120+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:24.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:24.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:25.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:25.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:25.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:25.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:25.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:25.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:26.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:26.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:26.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:26.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:26.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:26.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:27.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:27.096+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:27.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:27.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:27.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:27.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:28.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:28.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:28.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:28.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:28.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:28.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:29.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:29.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:29.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:29.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:29.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:29.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:30.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:30.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:30.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:30.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:30.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:30.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:31.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:31.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:31.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:31.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:31.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:31.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:32.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:32.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:32.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:32.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:32.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:32.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:33.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:33.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:33.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:33.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:33.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:33.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:34.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:34.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:34.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:34.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:34.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:34.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:35.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:35.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:35.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:35.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:35.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:35.668+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:36.033 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:36.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:36.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:36.112+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:36.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:36.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:37.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:37.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:37.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:37.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:37.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:37.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:37.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:37.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:38.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:38.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:38.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:38.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:39.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:39.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:39.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:39.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:39.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:39.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:40.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:40.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:40.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:40.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:40.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:40.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:41.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:41.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:41.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:41.052+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:41.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:41.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:41.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:41.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:42.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:42.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:42.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:42.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:43.004 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:43.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:43.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:43.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:43.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:43.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:44.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:44.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:44.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:44.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:44.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:44.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:45.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:45.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:45.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:45.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:45.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:45.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:46.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:46.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:46.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:46.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:46.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:46.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:46.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:46.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:47.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:47.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:47.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:47.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:48.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:47.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:48.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:48.112+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:48.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:48.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:48.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:48.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:49.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:49.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:49.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:49.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:49.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:49.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:50.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:50.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:50.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:50.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:50.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:50.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:51.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:51.116+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:51.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:51.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:52.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:52.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:52.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:52.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:52.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:52.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:53.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:53.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:53.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:53.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:53.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:53.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:54.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:54.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:54.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:54.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:54.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:54.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:55.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:55.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:55.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:55.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:55.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:55.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:56.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:56.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:56.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:56.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:56.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:56.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:57.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:57.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:57.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:57.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:57.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:57.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:58.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:58.023+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:58.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:58.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:58.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:58.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:59.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:44:59.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:44:59.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:44:59.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:44:59.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:44:59.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:00.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:00.015+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:00.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:00.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:00.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:00.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:01.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:01.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:01.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:01.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:01.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:01.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:02.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:02.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:02.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:02.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:02.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:02.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:03.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:03.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:03.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:03.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:03.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:03.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:04.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:04.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:04.254 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:04.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:04.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:04.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:05.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:05.011+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:05.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:05.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:05.860 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:05.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:06.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:06.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:06.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:06.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:06.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:06.899+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:07.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:07.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:07.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:07.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:07.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:07.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:08.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:08.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:08.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:08.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:08.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:08.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:09.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:09.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:09.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:09.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:09.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:09.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:10.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:10.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:10.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:10.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:10.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:10.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:11.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:11.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:11.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:11.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:11.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:11.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:12.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:12.107+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:12.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:12.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:12.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:12.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:13.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:13.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:13.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:13.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:13.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:13.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:14.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:14.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:14.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:14.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:14.929 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:14.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:15.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:15.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:15.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:15.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:15.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:15.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:16.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:16.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:16.207 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:16.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:16.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:16.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:17.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:17.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:17.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:17.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:17.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:17.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:18.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:18.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:18.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:18.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:18.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:18.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:19.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:19.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:19.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:19.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:19.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:19.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:20.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:20.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:20.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:20.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:20.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:20.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:21.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:21.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:21.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:21.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:21.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:21.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:22.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:22.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:22.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:22.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:22.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:22.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:23.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:23.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:23.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:23.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:23.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:23.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:24.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:24.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:24.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:24.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:24.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:24.967+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:25.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:25.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:25.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:25.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:26.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:25.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:26.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:26.047+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:26.139 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:26.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:26.977 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:26.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:27.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:27.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:27.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:27.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:27.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:27.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:28.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:28.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:28.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:28.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:28.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:28.927+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:29.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:29.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:29.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:29.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:29.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:29.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:30.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:30.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:30.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:30.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:30.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:30.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:31.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:31.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:31.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:31.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:31.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:31.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:32.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:32.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:32.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:32.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:32.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:32.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:33.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:33.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:33.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:33.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:33.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:33.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:34.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:34.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:34.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:34.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:34.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:34.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:35.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:35.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:35.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:35.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:35.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:35.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:36.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:36.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:36.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:36.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:36.896 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:36.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:37.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:37.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:37.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:37.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:37.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:37.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:38.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:38.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:38.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:38.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:38.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:38.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:39.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:39.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:39.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:39.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:39.973 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:39.967+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:40.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:40.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:40.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:40.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:40.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:40.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:41.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:41.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:41.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:41.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:41.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:41.970+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:42.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:42.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:42.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:42.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:42.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:42.930+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:43.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:43.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:43.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:43.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:43.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:43.894+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:44.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:44.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:44.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:44.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:44.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:44.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:45.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:45.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:45.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:45.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:45.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:45.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:46.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:46.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:46.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:46.314+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:46.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:46.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:47.241 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:47.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:47.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:47.334+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:47.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:47.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:48.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:48.266+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:48.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:48.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:48.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:48.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:49.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:49.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:49.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:49.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:49.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:49.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:50.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:50.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:50.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:50.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:50.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:50.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:51.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:51.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:51.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:51.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:51.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:51.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:52.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:52.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:52.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:52.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:52.933 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:52.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:53.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:53.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:53.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:53.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:53.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:53.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:54.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:54.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:54.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:54.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:54.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:54.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:55.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:55.294+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:55.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:55.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:55.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:55.982+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:56.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:56.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:56.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:56.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:56.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:56.942+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:57.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:57.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:57.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:57.330+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:57.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:57.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:58.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:58.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:58.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:58.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:59.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:45:59.026+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:45:59.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:45:59.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:45:59.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:45:59.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:00.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:00.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:00.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:00.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:00.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:00.346+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:00.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:00.974+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:01.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:01.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:01.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:01.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:01.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:01.982+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:02.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:02.330+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:02.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:02.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:02.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:02.962+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:03.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:03.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:03.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:03.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:03.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:03.954+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:04.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:04.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:04.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:04.362+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:04.994 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:04.990+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:05.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:05.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:05.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:05.346+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:06.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:06.010+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:06.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:06.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:06.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:06.354+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:07.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:07.050+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:07.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:07.350+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:07.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:07.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:08.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:08.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:08.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:08.370+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:08.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:08.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:09.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:09.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:09.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:09.354+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:09.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:09.354+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:10.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:10.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:10.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:10.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:10.381 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:10.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:11.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:11.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:11.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:11.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:11.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:11.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:12.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:12.082+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:12.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:12.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:12.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:12.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:13.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:13.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:13.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:13.274+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:13.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:13.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:14.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:14.082+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:14.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:14.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:14.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:14.314+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:15.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:15.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:15.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:15.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:15.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:15.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:16.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:16.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:16.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:16.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:16.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:16.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:17.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:17.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:17.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:17.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:17.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:17.294+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:18.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:18.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:18.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:18.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:18.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:18.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:19.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:19.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:19.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:19.278+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:19.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:19.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:20.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:20.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:20.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:20.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:20.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:20.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:21.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:21.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:21.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:21.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:21.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:21.346+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:22.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:22.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:22.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:22.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:22.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:22.346+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:23.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:23.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:23.246 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:23.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:23.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:23.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:24.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:24.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:24.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:24.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:24.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:24.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:25.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:25.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:25.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:25.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:25.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:25.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:26.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:26.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:26.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:26.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:26.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:26.382+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:27.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:27.117+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:27.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:27.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:27.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:27.353+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:28.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:28.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:28.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:28.165+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:28.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:28.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:29.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:29.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:29.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:29.165+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:29.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:29.361+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:30.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:30.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:30.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:30.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:30.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:30.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:31.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:31.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:31.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:31.193+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:31.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:31.317+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:32.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:32.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:32.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:32.221+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:32.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:32.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:33.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:33.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:33.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:33.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:33.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:33.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:34.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:34.181+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:34.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:34.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:34.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:34.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:35.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:35.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:35.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:35.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:35.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:35.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:36.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:36.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:36.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:36.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:36.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:36.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:37.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:37.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:37.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:37.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:37.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:37.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:38.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:38.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:38.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:38.205+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:38.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:38.265+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:39.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:39.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:39.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:39.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:39.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:39.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:40.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:40.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:40.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:40.157+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:40.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:40.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:41.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:41.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:41.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:41.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:41.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:41.213+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:42.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:42.105+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:42.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:42.177+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:42.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:42.253+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:43.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:43.141+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:43.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:43.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:43.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:43.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:44.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:44.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:44.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:44.173+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:44.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:44.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:45.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:45.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:45.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:45.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:45.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:45.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:46.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:46.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:46.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:46.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:46.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:46.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:47.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:47.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:47.194 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:47.193+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:47.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:47.361+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:48.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:48.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:48.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:48.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:48.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:48.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:49.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:49.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:49.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:49.173+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:49.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:49.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:50.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:50.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:50.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:50.193+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:50.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:50.437+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:51.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:51.161+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:51.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:51.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:51.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:51.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:52.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:52.149+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:52.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:52.177+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:52.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:52.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:53.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:53.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:53.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:53.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:53.401 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:53.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:54.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:54.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:54.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:54.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:54.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:54.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:55.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:55.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:55.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:55.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:55.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:55.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:56.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:56.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:56.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:56.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:56.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:56.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:57.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:57.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:57.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:57.173+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:57.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:57.457+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:58.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:58.013+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:58.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:58.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:58.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:58.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:59.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:46:59.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:46:59.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:46:59.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:46:59.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:46:59.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:00.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:00.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:00.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:00.213+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:00.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:00.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:01.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:01.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:01.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:01.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:01.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:01.437+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:02.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:02.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:02.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:02.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:02.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:02.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:03.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:03.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:03.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:03.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:03.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:03.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:04.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:04.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:04.249 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:04.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:04.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:04.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:05.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:05.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:05.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:05.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:05.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:05.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:06.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:06.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:06.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:06.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:06.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:06.437+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:07.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:07.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:07.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:07.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:07.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:07.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:08.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:08.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:08.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:08.281+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:08.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:08.373+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:09.033 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:09.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:09.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:09.237+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:09.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:09.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:10.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:10.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:10.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:10.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:10.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:10.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:11.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:11.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:11.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:11.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:11.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:11.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:12.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:12.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:12.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:12.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:12.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:12.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:13.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:13.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:13.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:13.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:13.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:13.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:14.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:14.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:14.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:14.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:14.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:14.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:15.086 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:15.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:15.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:15.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:15.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:15.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:16.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:16.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:16.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:16.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:16.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:16.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:17.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:17.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:17.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:17.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:17.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:17.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:18.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:18.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:18.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:18.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:18.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:18.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:19.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:19.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:19.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:19.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:19.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:19.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:20.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:20.200+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:20.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:20.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:20.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:20.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:21.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:21.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:21.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:21.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:21.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:21.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:22.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:22.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:22.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:22.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:22.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:22.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:23.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:23.212+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:23.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:23.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:23.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:23.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:24.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:24.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:24.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:24.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:24.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:24.480+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:25.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:25.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:25.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:25.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:25.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:25.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:26.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:26.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:26.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:26.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:26.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:26.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:27.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:27.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:27.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:27.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:27.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:27.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:28.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:28.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:28.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:28.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:28.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:28.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:29.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:29.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:29.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:29.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:29.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:29.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:30.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:30.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:30.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:30.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:30.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:30.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:31.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:31.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:31.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:31.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:31.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:31.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:32.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:32.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:32.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:32.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:32.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:32.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:33.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:33.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:33.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:33.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:33.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:33.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:34.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:34.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:34.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:34.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:34.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:34.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:35.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:35.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:35.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:35.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:35.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:35.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:36.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:36.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:36.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:36.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:36.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:36.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:37.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:37.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:37.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:37.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:37.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:37.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:38.093 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:38.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:38.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:38.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:38.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:38.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:39.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:39.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:39.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:39.140+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:39.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:39.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:40.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:40.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:40.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:40.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:40.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:40.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:41.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:41.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:41.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:41.092+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:41.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:41.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:42.054 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:42.052+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:42.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:42.140+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:42.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:42.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:43.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:43.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:43.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:43.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:43.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:43.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:44.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:44.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:44.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:44.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:44.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:44.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:45.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:45.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:45.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:45.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:45.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:45.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:46.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:46.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:46.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:46.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:46.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:46.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:47.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:47.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:47.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:47.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:47.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:47.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:48.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:48.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:48.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:48.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:48.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:48.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:49.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:49.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:49.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:49.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:49.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:49.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:50.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:50.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:50.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:50.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:50.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:50.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:51.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:51.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:51.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:51.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:51.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:51.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:52.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:52.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:52.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:52.268+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:52.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:52.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:53.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:53.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:53.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:53.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:53.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:53.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:54.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:54.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:54.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:54.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:54.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:54.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:55.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:55.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:55.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:55.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:55.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:55.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:56.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:56.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:56.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:56.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:56.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:56.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:57.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:57.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:57.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:57.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:57.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:57.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:58.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:58.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:58.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:58.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:58.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:58.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:59.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:47:59.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:47:59.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:47:59.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:47:59.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:47:59.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:00.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:00.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:00.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:00.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:00.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:00.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:01.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:01.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:01.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:01.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:01.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:01.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:02.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:02.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:02.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:02.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:02.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:02.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:03.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:03.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:03.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:03.275+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:03.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:03.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:04.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:04.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:04.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:04.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:04.315 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:04.311+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:05.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:05.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:05.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:05.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:05.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:05.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:06.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:06.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:06.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:06.275+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:06.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:06.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:07.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:07.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:07.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:07.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:07.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:07.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:08.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:08.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:08.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:08.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:08.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:08.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:09.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:09.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:09.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:09.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:09.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:09.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:10.236 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:10.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:10.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:10.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:10.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:10.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:11.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:11.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:11.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:11.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:11.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:11.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:12.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:12.167+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:12.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:12.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:12.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:12.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:13.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:13.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:13.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:13.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:13.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:13.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:14.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:14.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:14.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:14.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:14.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:14.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:15.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:15.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:15.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:15.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:15.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:15.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:16.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:16.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:16.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:16.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:16.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:16.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:17.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:17.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:17.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:17.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:17.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:17.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:18.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:18.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:18.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:18.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:18.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:18.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:19.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:19.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:19.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:19.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:19.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:19.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:20.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:20.191+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:20.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:20.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:20.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:20.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:21.189 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:21.183+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:21.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:21.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:21.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:21.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:22.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:22.139+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:22.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:22.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:22.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:22.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:23.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:23.115+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:23.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:23.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:23.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:23.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:24.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:24.123+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:24.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:24.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:24.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:24.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:25.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:25.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:25.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:25.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:25.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:25.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:26.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:26.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:26.185 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:26.179+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:26.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:26.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:27.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:27.159+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:27.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:27.215+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:27.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:27.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:28.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:28.195+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:28.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:28.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:28.215 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:28.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:29.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:29.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:29.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:29.191+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:29.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:29.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:30.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:30.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:30.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:30.207+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:30.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:30.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:31.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:31.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:31.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:31.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:31.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:31.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:32.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:32.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:32.261 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:32.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:32.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:32.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:33.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:33.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:33.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:33.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:33.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:33.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:34.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:34.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:34.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:34.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:34.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:34.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:35.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:35.279+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:35.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:35.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:35.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:35.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:36.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:36.279+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:36.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:36.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:36.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:36.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:37.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:37.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:37.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:37.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:37.360 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:37.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:38.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:38.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:38.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:38.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:38.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:38.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:39.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:39.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:39.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:39.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:39.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:39.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:40.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:40.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:40.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:40.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:40.359 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:40.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:41.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:41.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:41.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:41.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:41.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:41.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:42.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:42.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:42.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:42.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:42.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:42.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:43.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:43.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:43.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:43.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:43.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:43.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:44.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:44.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:44.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:44.331+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:44.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:44.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:45.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:45.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:45.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:45.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:45.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:45.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:46.233 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:46.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:46.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:46.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:46.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:46.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:47.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:47.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:47.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:47.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:47.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:47.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:48.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:48.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:48.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:48.350+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:48.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:48.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:49.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:49.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:49.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:49.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:49.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:49.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:50.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:50.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:50.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:50.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:50.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:50.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:51.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:51.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:51.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:51.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:51.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:51.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:52.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:52.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:52.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:52.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:52.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:52.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:53.273 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:53.266+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:53.410 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:53.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:53.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:53.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:54.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:54.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:54.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:54.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:54.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:54.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:55.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:55.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:55.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:55.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:55.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:55.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:56.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:56.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:56.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:56.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:56.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:56.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:57.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:57.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:57.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:57.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:57.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:57.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:58.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:58.230+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:58.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:58.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:58.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:58.506+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:59.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:48:59.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:48:59.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:48:59.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:48:59.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:48:59.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:00.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:00.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:00.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:00.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:00.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:00.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:01.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:01.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:01.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:01.414+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:01.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:01.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:02.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:02.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:02.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:02.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:02.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:02.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:03.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:03.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:03.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:03.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:03.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:03.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:04.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:04.138+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:04.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:04.410+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:04.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:04.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:05.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:05.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:05.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:05.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:05.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:05.506+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:06.141 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:06.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:06.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:06.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:06.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:06.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:07.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:07.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:07.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:07.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:07.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:07.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:08.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:08.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:08.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:08.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:08.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:08.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:09.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:09.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:09.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:09.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:09.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:09.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:10.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:10.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:10.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:10.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:10.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:10.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:11.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:11.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:11.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:11.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:11.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:11.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:12.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:12.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:12.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:12.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:12.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:12.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:13.012 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:13.006+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:13.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:13.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:13.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:13.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:14.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:13.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:14.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:14.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:14.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:14.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:15.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:15.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:15.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:15.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:15.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:15.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:16.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:16.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:16.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:16.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:16.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:16.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:17.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:17.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:17.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:17.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:17.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:17.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:18.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:18.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:18.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:18.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:18.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:18.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:19.111 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:19.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:19.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:19.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:19.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:19.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:20.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:20.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:20.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:20.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:20.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:20.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:21.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:21.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:21.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:21.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:21.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:21.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:22.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:22.090+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:22.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:22.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:22.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:22.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:23.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:23.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:23.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:23.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:23.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:23.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:24.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:24.098+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:24.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:24.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:24.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:24.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:25.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:25.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:25.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:25.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:25.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:25.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:26.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:26.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:26.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:26.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:26.865 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:26.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:27.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:27.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:27.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:27.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:27.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:27.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:28.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:28.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:28.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:28.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:28.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:28.870+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:29.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:29.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:29.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:29.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:29.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:29.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:30.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:30.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:30.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:30.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:30.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:30.945+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:31.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:31.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:31.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:31.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:31.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:31.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:32.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:32.173+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:32.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:32.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:32.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:32.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:33.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:33.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:33.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:33.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:33.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:33.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:34.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:34.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:34.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:34.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:34.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:34.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:35.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:35.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:35.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:35.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:35.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:35.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:36.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:36.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:36.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:36.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:36.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:36.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:37.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:37.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:37.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:37.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:38.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:38.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:38.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:38.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:38.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:38.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:39.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:39.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:39.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:39.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:39.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:39.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:39.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:39.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:40.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:40.061+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:40.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:40.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:41.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:41.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:41.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:41.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:41.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:41.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:42.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:42.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:42.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:42.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:42.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:42.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:43.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:43.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:43.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:43.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:43.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:43.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:44.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:44.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:44.059 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:44.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:44.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:44.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:44.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:44.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:45.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:45.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:45.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:45.529+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:45.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:45.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:46.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:46.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:46.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:46.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:46.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:46.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:47.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:47.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:47.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:47.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:48.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:48.033+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:48.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:48.097+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:48.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:48.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:49.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:49.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:49.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:49.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:49.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:49.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:50.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:50.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:50.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:50.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:50.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:50.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:50.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:50.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:51.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:51.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:51.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:51.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:52.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:52.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:52.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:52.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:52.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:52.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:53.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:53.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:53.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:53.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:53.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:53.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:54.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:54.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:54.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:54.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:54.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:54.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:54.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:54.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:55.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:55.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:55.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:55.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:55.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:55.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:56.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:56.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:56.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:56.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:56.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:56.977+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:57.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:57.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:57.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:57.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:57.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:57.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:58.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:58.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:58.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:58.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:59.006 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:49:59.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:49:59.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:49:59.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:49:59.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:49:59.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:00.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:00.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:00.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:00.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:00.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:00.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:00.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:00.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:01.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:01.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:01.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:01.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:02.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:02.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:02.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:02.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:02.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:02.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:03.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:03.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:03.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:03.249+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:03.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:03.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:04.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:04.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:04.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:04.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:04.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:04.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:04.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:04.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:05.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:05.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:05.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:05.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:06.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:06.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:06.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:06.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:06.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:06.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:07.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:07.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:07.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:07.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:07.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:07.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:08.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:08.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:08.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:08.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:08.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:08.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:09.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:09.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:09.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:09.321+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:09.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:09.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:10.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:10.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:10.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:10.361+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:10.394 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:10.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:11.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:11.073+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:11.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:11.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:11.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:11.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:12.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:12.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:12.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:12.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:12.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:12.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:13.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:13.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:13.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:13.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:13.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:13.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:14.085 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:14.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:14.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:14.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:14.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:14.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:15.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:15.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:15.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:15.369+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:15.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:15.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:16.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:16.089+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:16.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:16.409+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:16.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:16.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:17.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:17.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:17.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:17.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:17.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:17.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:18.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:18.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:18.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:18.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:18.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:18.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:19.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:19.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:19.373 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:19.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:19.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:19.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:20.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:20.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:20.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:20.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:20.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:20.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:21.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:21.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:21.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:21.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:21.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:21.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:22.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:22.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:22.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:22.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:22.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:22.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:23.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:23.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:23.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:23.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:23.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:23.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:24.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:24.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:24.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:24.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:24.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:24.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:25.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:25.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:25.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:25.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:25.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:25.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:26.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:26.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:26.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:26.244+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:26.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:26.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:27.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:27.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:27.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:27.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:27.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:27.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:28.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:28.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:28.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:28.312+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:28.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:28.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:29.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:29.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:29.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:29.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:29.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:29.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:30.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:30.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:30.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:30.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:30.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:30.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:31.216 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:31.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:31.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:31.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:31.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:31.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:32.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:32.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:32.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:32.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:32.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:32.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:33.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:33.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:33.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:33.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:33.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:33.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:34.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:34.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:34.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:34.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:34.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:34.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:35.184 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:35.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:35.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:35.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:35.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:35.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:36.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:36.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:36.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:36.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:36.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:36.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:37.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:37.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:37.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:37.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:37.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:37.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:38.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:38.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:38.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:38.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:38.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:38.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:39.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:39.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:39.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:39.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:39.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:39.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:40.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:40.268+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:40.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:40.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:40.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:40.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:41.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:41.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:41.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:41.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:41.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:41.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:42.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:42.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:42.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:42.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:42.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:42.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:43.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:43.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:43.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:43.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:43.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:43.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:44.280 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:44.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:44.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:44.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:44.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:44.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:45.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:45.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:45.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:45.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:45.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:45.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:46.270 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:46.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:46.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:46.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:46.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:46.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:47.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:47.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:47.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:47.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:47.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:47.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:48.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:48.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:48.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:48.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:48.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:48.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:49.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:49.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:49.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:49.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:49.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:49.580+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:50.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:50.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:50.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:50.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:50.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:50.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:51.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:51.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:51.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:51.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:51.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:51.548+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:52.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:52.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:52.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:52.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:52.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:52.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:53.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:53.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:53.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:53.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:53.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:53.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:54.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:54.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:54.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:54.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:54.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:54.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:55.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:55.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:55.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:55.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:55.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:55.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:56.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:56.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:56.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:56.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:56.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:56.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:57.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:57.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:57.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:57.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:57.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:57.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:58.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:58.344+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:58.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:58.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:58.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:58.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:59.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:50:59.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:50:59.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:50:59.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:50:59.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:50:59.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:00.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:00.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:00.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:00.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:00.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:00.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:01.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:01.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:01.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:01.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:01.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:01.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:02.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:02.324+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:02.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:02.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:02.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:02.608+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:03.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:03.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:03.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:03.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:03.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:03.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:04.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:04.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:04.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:04.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:04.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:04.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:05.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:05.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:05.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:05.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:05.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:05.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:06.196 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:06.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:06.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:06.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:06.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:06.663+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:07.239 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:07.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:07.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:07.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:07.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:07.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:08.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:08.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:08.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:08.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:08.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:08.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:09.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:09.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:09.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:09.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:09.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:09.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:10.213 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:10.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:10.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:10.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:10.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:10.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:11.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:11.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:11.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:11.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:11.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:11.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:12.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:12.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:12.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:12.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:12.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:12.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:13.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:13.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:13.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:13.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:13.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:13.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:14.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:14.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:14.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:14.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:14.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:14.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:15.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:15.123+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:15.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:15.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:15.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:15.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:16.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:16.091+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:16.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:16.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:16.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:16.707+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:17.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:17.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:17.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:17.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:17.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:17.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:18.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:18.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:18.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:18.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:18.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:18.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:19.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:19.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:19.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:19.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:19.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:19.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:20.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:20.011+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:20.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:20.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:20.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:20.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:21.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:21.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:21.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:21.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:21.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:21.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:22.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:22.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:22.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:22.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:22.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:22.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:23.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:23.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:23.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:23.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:23.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:23.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:24.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:24.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:24.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:24.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:24.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:24.775+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:24.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:24.991+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:25.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:25.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:25.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:25.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:26.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:26.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:26.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:26.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:26.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:26.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:26.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:26.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:27.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:27.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:27.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:27.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:28.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:28.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:28.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:28.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:28.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:28.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:29.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:29.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:29.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:29.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:29.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:29.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:30.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:30.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:30.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:30.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:30.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:30.715+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:31.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:31.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:31.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:31.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:31.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:31.703+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:32.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:32.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:32.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:32.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:32.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:32.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:33.095 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:33.091+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:33.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:33.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:33.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:33.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:34.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:34.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:34.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:34.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:34.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:34.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:35.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:35.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:35.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:35.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:35.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:35.743+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:36.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:36.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:36.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:36.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:36.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:36.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:37.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:37.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:37.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:37.583+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:37.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:37.703+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:38.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:38.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:38.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:38.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:38.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:38.679+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:39.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:39.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:39.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:39.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:39.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:39.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:40.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:40.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:40.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:40.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:40.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:40.707+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:41.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:41.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:41.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:41.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:41.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:41.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:41.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:41.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:42.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:42.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:42.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:42.695+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:42.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:42.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:43.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:43.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:43.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:43.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:43.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:43.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:44.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:44.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:44.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:44.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:44.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:44.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:45.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:45.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:45.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:45.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:45.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:45.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:46.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:46.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:46.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:46.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:46.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:46.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:47.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:47.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:47.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:47.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:47.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:47.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:48.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:48.587+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:48.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:48.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:48.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:48.902+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:49.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:49.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:49.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:49.706+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:49.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:49.870+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:50.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:50.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:50.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:50.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:50.882 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:50.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:51.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:51.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:51.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:51.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:51.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:51.830+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:52.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:52.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:52.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:52.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:52.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:52.798+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:53.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:53.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:53.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:53.686+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:53.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:53.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:54.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:54.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:54.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:54.642+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:54.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:54.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:55.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:55.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:55.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:55.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:55.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:55.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:56.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:56.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:56.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:56.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:56.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:56.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:57.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:57.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:57.743 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:57.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:57.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:57.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:58.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:58.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:58.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:58.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:58.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:58.794+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:59.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:51:59.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:51:59.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:51:59.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:51:59.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:51:59.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:00.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:00.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:00.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:00.766+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:00.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:00.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:01.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:01.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:01.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:01.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:01.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:01.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:02.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:02.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:02.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:02.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:02.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:02.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:03.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:03.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:03.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:03.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:03.793 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:03.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:04.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:04.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:04.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:04.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:04.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:04.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:05.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:05.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:05.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:05.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:05.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:05.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:06.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:06.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:06.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:06.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:06.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:06.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:07.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:07.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:07.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:07.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:07.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:07.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:08.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:08.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:08.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:08.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:08.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:08.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:09.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:09.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:09.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:09.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:09.797 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:09.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:10.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:10.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:10.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:10.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:10.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:10.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:11.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:11.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:11.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:11.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:11.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:11.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:12.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:12.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:12.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:12.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:12.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:12.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:13.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:13.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:13.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:13.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:13.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:13.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:14.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:14.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:14.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:14.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:14.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:14.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:15.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:15.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:15.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:15.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:15.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:15.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:16.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:16.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:16.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:16.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:16.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:16.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:17.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:17.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:17.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:17.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:17.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:17.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:18.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:18.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:18.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:18.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:18.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:18.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:19.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:19.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:19.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:19.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:19.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:19.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:20.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:20.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:20.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:20.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:20.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:20.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:21.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:21.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:21.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:21.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:21.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:21.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:22.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:22.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:22.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:22.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:22.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:22.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:23.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:23.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:23.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:23.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:23.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:23.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:24.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:24.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:24.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:24.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:24.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:24.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:25.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:25.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:25.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:25.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:25.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:25.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:26.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:26.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:26.660 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:26.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:26.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:26.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:27.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:27.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:27.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:27.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:27.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:27.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:28.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:28.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:28.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:28.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:28.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:28.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:29.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:29.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:29.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:29.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:29.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:29.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:30.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:30.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:30.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:30.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:30.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:30.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:31.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:31.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:31.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:31.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:31.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:31.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:32.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:32.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:32.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:32.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:32.753 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:32.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:33.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:33.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:33.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:33.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:33.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:33.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:34.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:34.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:34.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:34.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:34.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:34.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:35.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:35.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:35.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:35.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:35.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:35.785+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:36.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:36.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:36.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:36.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:36.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:36.829+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:37.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:37.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:37.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:37.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:37.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:37.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:38.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:38.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:38.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:38.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:38.856 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:38.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:39.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:39.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:39.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:39.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:39.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:39.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:40.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:40.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:40.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:40.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:40.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:40.809+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:41.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:41.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:41.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:41.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:41.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:41.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:42.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:42.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:42.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:42.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:42.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:42.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:43.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:43.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:43.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:43.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:43.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:43.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:44.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:44.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:44.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:44.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:44.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:44.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:45.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:45.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:45.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:45.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:45.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:45.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:46.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:46.481+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:46.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:46.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:46.692 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:46.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:47.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:47.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:47.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:47.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:47.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:47.717+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:48.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:48.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:48.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:48.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:48.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:48.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:49.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:49.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:49.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:49.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:49.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:49.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:50.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:50.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:50.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:50.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:50.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:50.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:51.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:51.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:51.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:51.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:51.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:51.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:52.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:52.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:52.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:52.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:52.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:52.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:53.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:53.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:53.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:53.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:53.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:53.725+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:54.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:54.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:54.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:54.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:54.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:54.741+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:55.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:55.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:55.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:55.705+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:55.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:55.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:56.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:56.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:56.704 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:56.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:56.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:56.709+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:57.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:57.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:57.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:57.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:57.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:57.737+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:58.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:58.377+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:58.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:58.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:58.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:58.745+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:52:59.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:52:59.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:59.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:52:59.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:52:59.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:52:59.757+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:00.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:00.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:00.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:00.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:00.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:00.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:01.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:01.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:01.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:01.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:01.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:01.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:02.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:02.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:02.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:02.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:02.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:02.737+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:03.408 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:03.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:03.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:03.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:03.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:03.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:04.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:04.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:04.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:04.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:04.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:04.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:05.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:05.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:05.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:05.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:05.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:05.761+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:06.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:06.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:06.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:06.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:06.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:06.785+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:07.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:07.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:07.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:07.717+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:07.828 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:07.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:08.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:08.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:08.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:08.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:08.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:08.873+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:09.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:09.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:09.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:09.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:09.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:09.897+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:10.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:10.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:10.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:10.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:10.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:10.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:11.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:11.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:11.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:11.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:11.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:11.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:12.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:12.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:12.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:12.645+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:12.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:12.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:13.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:13.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:13.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:13.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:13.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:13.945+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:14.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:14.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:14.670 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:14.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:14.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:14.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:15.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:15.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:15.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:15.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:15.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:15.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:16.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:16.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:16.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:16.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:17.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:17.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:17.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:17.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:17.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:17.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:18.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:18.037+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:18.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:18.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:18.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:18.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:19.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:19.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:19.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:19.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:19.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:19.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:20.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:20.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:20.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:20.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:20.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:20.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:21.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:21.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:21.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:21.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:21.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:21.652+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:22.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:22.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:22.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:22.488+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:22.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:22.648+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:23.112 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:23.108+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:23.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:23.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:23.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:23.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:24.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:24.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:24.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:24.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:24.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:24.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:25.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:25.088+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:25.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:25.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:25.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:25.636+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:26.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:26.056+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:26.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:26.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:26.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:26.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:27.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:27.044+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:27.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:27.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:27.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:27.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:28.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:28.024+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:28.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:28.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:28.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:28.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:29.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:29.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:29.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:29.508+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:29.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:29.668+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:30.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:30.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:30.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:30.540+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:30.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:30.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:31.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:31.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:31.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:31.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:31.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:31.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:32.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:32.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:32.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:32.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:32.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:32.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:33.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:33.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:33.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:33.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:33.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:33.712+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:34.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:34.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:34.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:34.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:34.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:34.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:35.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:35.080+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:35.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:35.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:35.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:35.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:36.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:36.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:36.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:36.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:36.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:36.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:37.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:37.072+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:37.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:37.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:37.813 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:37.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:38.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:38.044+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:38.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:38.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:38.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:38.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:39.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:39.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:39.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:39.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:39.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:39.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:40.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:40.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:40.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:40.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:40.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:40.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:40.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:40.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:41.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:41.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:41.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:41.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:41.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:41.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:42.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:42.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:42.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:42.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:42.946 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:42.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:43.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:43.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:43.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:43.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:43.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:43.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:44.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:44.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:44.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:44.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:44.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:44.992+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:45.181 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T18:53:45.176+0000 7fbca072b700 0 -- 172.21.15.196:0/2198265222 >> [v2:172.21.15.196:6800/30123,v1:172.21.15.196:6801/30123] conn(0x55c57a99b570 msgr2=0x7fbc80058710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-11-08T18:53:45.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:45.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:45.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:45.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:45.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:45.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:46.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:46.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:46.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:46.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:46.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:46.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:47.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:47.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:47.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:47.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:47.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:47.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:48.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:48.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:48.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:48.808+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:48.887 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:48.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:49.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:49.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:49.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:49.760+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:49.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:49.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:50.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:50.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:50.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:50.784+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:50.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:50.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:51.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:51.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:51.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:51.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:51.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:51.908+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:52.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:52.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:52.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:52.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:52.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:52.908+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:53.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:53.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:53.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:53.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:53.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:53.892+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:54.694 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:54.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:54.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:54.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:54.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:54.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:55.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:55.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:55.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:55.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:55.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:55.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:56.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:56.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:56.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:56.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:56.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:56.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:57.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:57.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:57.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:57.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:57.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:57.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:58.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:58.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:58.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:58.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:58.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:58.984+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:53:59.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:53:59.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:59.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:53:59.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:53:59.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:53:59.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:00.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:00.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:00.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:00.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:00.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:00.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:01.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:01.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:01.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:01.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:01.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:01.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:02.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:02.712+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:02.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:02.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:02.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:02.932+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:03.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:03.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:03.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:03.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:03.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:03.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:04.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:04.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:04.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:04.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:04.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:04.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:05.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:05.660+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:05.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:05.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:05.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:05.944+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:06.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:06.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:06.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:06.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:06.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:06.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:07.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:07.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:07.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:07.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:07.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:07.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:08.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:08.659+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:08.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:08.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:08.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:08.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:09.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:09.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:09.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:09.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:09.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:09.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:10.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:10.635+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:10.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:10.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:10.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:10.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:11.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:11.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:11.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:11.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:11.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:11.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:12.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:12.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:12.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:12.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:12.939 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:12.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:13.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:13.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:13.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:13.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:13.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:13.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:14.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:14.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:14.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:14.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:14.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:14.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:15.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:15.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:15.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:15.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:15.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:15.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:16.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:16.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:16.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:16.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:16.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:16.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:17.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:17.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:17.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:17.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:17.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:17.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:18.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:18.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:18.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:18.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:18.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:18.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:19.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:19.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:19.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:19.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:19.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:19.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:20.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:20.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:20.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:20.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:20.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:20.971+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:21.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:21.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:21.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:21.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:21.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:21.943+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:22.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:22.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:22.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:22.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:22.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:22.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:23.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:23.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:23.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:23.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:23.943 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:23.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:24.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:24.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:24.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:24.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:24.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:24.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:25.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:25.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:25.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:25.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:26.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:26.011+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:26.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:26.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:26.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:26.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:27.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:27.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:27.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:27.607+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:27.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:27.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:28.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:28.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:28.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:28.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:28.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:28.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:29.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:29.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:29.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:29.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:29.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:29.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:30.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:30.063+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:30.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:30.663+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:30.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:30.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:31.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:31.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:31.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:31.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:31.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:31.659+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:32.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:32.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:32.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:32.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:32.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:32.707+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:33.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:33.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:33.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:33.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:33.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:33.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:34.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:34.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:34.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:34.599+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:34.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:34.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:35.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:35.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:35.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:35.619+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:35.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:35.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:36.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:35.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:36.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:36.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:36.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:36.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:37.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:36.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:37.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:37.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:37.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:37.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:38.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:38.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:38.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:38.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:38.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:38.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:39.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:39.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:39.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:39.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:39.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:39.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:40.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:40.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:40.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:40.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:40.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:40.791+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:41.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:41.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:41.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:41.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:41.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:41.823+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:41.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:41.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:42.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:42.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:42.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:42.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:43.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:43.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:43.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:43.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:43.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:43.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:44.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:44.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:44.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:44.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:44.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:44.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:45.075 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:45.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:45.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:45.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:45.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:45.779+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:46.114 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:46.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:46.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:46.599+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:46.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:46.743+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:47.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:47.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:47.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:47.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:47.788 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:47.783+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:48.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:48.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:48.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:48.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:48.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:48.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:49.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:49.107+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:49.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:49.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:49.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:49.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:50.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:50.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:50.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:50.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:50.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:50.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:51.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:51.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:51.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:51.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:51.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:51.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:52.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:52.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:52.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:52.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:52.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:52.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:53.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:53.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:53.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:53.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:53.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:53.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:54.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:54.002+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:54.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:54.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:54.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:54.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:54.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:54.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:55.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:55.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:55.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:55.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:55.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:55.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:56.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:56.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:56.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:56.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:56.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:56.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:57.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:57.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:57.831 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:57.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:57.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:57.838+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:58.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:58.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:58.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:58.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:54:58.877 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:58.870+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:59.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:54:59.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:59.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:54:59.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:54:59.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:54:59.862+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:00.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:00.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:00.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:00.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:00.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:00.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:01.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:01.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:01.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:01.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:01.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:01.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:02.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:02.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:02.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:02.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:02.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:02.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:03.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:03.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:03.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:03.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:03.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:03.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:04.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:04.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:04.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:04.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:04.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:04.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:05.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:05.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:05.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:05.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:05.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:05.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:06.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:06.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:06.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:06.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:06.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:06.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:07.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:07.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:07.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:07.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:07.860 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:07.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:08.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:08.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:08.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:08.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:08.862 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:08.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:09.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:09.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:09.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:09.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:09.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:09.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:10.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:10.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:10.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:10.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:10.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:10.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:11.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:11.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:11.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:11.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:11.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:11.818+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:12.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:12.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:12.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:12.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:12.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:12.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:13.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:13.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:13.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:13.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:13.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:13.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:14.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:14.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:14.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:14.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:14.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:14.930+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:15.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:15.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:15.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:15.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:15.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:15.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:16.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:16.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:16.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:16.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:16.860 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:16.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:17.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:17.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:17.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:17.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:17.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:17.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:18.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:18.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:18.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:18.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:18.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:18.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:19.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:19.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:19.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:19.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:19.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:19.922+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:20.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:20.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:20.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:20.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:20.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:20.886+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:21.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:21.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:21.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:21.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:21.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:21.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:22.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:22.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:22.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:22.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:22.879 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:22.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:23.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:23.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:23.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:23.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:23.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:23.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:24.684 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:24.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:24.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:24.806+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:24.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:24.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:25.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:25.718+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:25.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:25.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:25.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:25.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:26.764 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:26.758+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:26.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:26.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:26.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:26.906+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:27.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:27.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:27.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:27.746+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:27.896 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:27.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:28.727 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:28.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:28.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:28.746+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:28.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:28.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:29.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:29.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:29.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:29.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:29.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:29.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:30.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:30.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:30.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:30.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:30.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:30.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:31.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:31.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:31.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:31.794+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:31.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:31.922+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:32.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:32.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:32.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:32.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:32.904 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:32.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:33.692 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:33.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:33.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:33.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:33.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:33.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:34.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:34.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:34.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:34.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:34.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:34.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:35.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:35.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:35.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:35.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:35.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:35.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:36.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:36.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:36.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:36.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:36.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:36.922+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:37.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:37.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:37.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:37.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:37.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:37.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:38.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:38.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:38.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:38.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:38.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:38.873+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:39.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:39.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:39.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:39.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:39.913 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:39.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:40.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:40.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:40.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:40.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:40.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:40.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:41.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:41.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:41.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:41.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:41.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:41.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:42.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:42.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:42.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:42.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:42.971 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:42.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:43.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:43.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:43.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:43.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:43.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:43.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:44.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:44.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:44.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:44.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:44.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:44.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:45.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:45.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:45.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:45.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:46.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:46.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:46.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:46.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:46.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:46.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:47.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:47.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:47.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:47.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:47.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:47.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:47.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:47.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:48.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:48.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:48.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:48.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:49.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:49.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:49.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:49.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:49.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:49.837+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:50.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:50.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:50.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:50.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:50.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:50.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:51.023 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:51.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:51.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:51.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:51.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:51.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:52.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:52.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:52.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:52.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:52.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:52.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:53.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:53.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:53.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:53.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:53.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:53.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:53.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:53.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:54.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:54.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:54.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:54.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:54.966 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:54.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:55.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:55.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:55.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:55.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:55.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:55.929+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:56.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:56.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:56.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:56.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:56.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:56.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:57.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:57.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:57.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:57.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:57.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:57.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:58.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:58.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:58.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:58.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:58.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:55:58.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:55:59.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:55:59.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:55:59.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:55:59.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:00.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:00.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:00.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:00.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:00.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:00.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:01.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:01.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:01.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:01.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:01.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:01.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:02.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:02.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:02.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:02.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:02.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:02.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:03.012 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:03.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:03.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:03.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:03.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:03.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:03.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:03.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:04.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:04.453+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:04.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:04.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:04.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:04.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:05.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:05.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:05.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:05.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:05.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:05.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:06.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:06.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:06.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:06.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:06.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:06.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:07.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:07.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:07.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:07.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:07.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:07.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:08.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:08.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:08.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:08.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:08.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:08.949+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:09.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:09.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:09.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:09.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:09.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:09.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:10.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:10.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:10.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:10.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:11.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:11.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:11.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:11.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:11.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:11.733+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:11.959 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:11.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:12.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:12.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:12.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:12.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:13.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:12.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:13.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:13.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:13.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:13.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:14.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:13.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:14.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:14.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:14.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:14.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:14.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:14.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:15.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:15.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:15.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:15.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:15.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:15.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:16.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:16.409+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:16.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:16.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:16.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:16.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:17.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:17.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:17.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:17.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:17.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:17.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:18.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:18.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:18.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:18.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:18.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:18.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:19.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:19.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:19.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:19.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:20.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:20.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:20.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:20.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:20.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:20.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:21.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:21.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:21.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:21.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:21.802 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:21.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:22.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:22.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:22.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:22.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:22.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:22.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:23.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:23.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:23.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:23.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:23.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:23.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:24.011 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:24.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:24.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:24.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:24.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:24.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:24.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:24.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:25.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:25.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:25.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:25.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:25.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:25.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:26.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:26.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:26.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:26.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:26.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:26.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:27.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:27.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:27.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:27.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:27.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:27.964+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:28.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:28.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:28.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:28.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:28.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:28.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:29.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:29.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:29.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:29.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:29.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:29.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:30.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:30.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:30.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:30.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:30.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:30.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:31.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:31.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:31.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:31.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:31.860 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:31.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:32.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:32.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:32.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:32.840+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:32.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:32.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:33.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:33.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:33.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:33.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:33.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:33.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:34.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:34.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:34.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:34.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:34.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:34.864+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:35.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:35.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:35.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:35.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:35.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:35.912+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:36.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:36.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:36.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:36.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:36.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:36.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:37.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:37.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:37.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:37.724+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:37.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:37.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:38.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:38.356+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:38.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:38.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:38.904 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:38.900+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:39.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:39.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:39.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:39.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:39.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:39.876+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:40.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:40.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:40.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:40.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:40.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:40.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:41.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:41.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:41.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:41.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:41.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:41.932+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:42.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:42.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:42.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:42.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:42.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:42.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:43.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:43.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:43.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:43.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:43.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:43.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:44.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:44.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:44.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:44.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:44.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:44.920+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:45.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:45.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:45.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:45.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:45.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:45.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:46.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:46.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:46.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:46.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:46.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:46.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:47.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:47.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:47.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:47.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:47.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:47.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:48.288 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:48.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:48.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:48.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:48.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:48.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:49.254 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:49.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:49.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:49.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:50.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:50.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:50.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:50.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:50.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:50.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:51.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:51.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:51.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:51.248+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:51.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:51.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:52.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:52.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:52.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:52.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:52.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:52.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:53.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:52.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:53.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:53.296+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:53.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:53.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:54.008 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:54.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:54.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:54.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:54.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:54.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:55.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:55.008+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:55.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:55.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:55.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:55.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:55.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:55.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:56.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:56.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:56.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:56.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:56.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:56.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:57.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:57.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:57.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:57.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:58.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:58.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:58.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:58.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:58.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:58.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:59.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:56:59.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:56:59.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:56:59.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:56:59.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:56:59.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:00.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:00.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:00.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:00.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:00.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:00.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:01.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:01.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:01.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:01.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:01.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:01.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:02.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:02.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:02.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:02.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:02.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:02.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:03.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:03.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:03.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:03.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:03.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:03.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:04.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:04.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:04.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:04.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:04.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:04.768+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:05.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:05.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:05.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:05.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:05.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:05.780+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:06.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:06.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:06.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:06.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:06.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:06.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:07.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:07.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:07.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:07.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:07.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:07.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:08.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:08.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:08.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:08.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:08.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:08.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:09.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:09.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:09.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:09.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:09.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:09.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:10.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:10.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:10.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:10.504+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:10.908 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:10.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:11.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:11.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:11.476 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:11.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:11.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:11.927+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:12.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:12.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:12.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:12.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:12.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:12.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:13.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:13.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:13.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:13.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:13.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:13.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:14.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:14.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:14.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:14.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:14.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:14.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:15.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:15.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:15.519 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:15.515+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:15.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:15.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:16.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:16.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:16.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:16.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:16.866 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:16.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:17.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:17.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:17.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:17.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:17.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:17.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:18.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:18.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:18.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:18.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:18.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:18.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:19.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:19.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:19.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:19.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:19.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:19.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:20.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:20.275+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:20.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:20.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:20.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:20.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:21.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:21.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:21.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:21.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:21.886 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:21.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:22.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:22.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:22.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:22.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:22.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:22.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:23.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:23.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:23.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:23.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:23.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:23.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:24.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:24.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:24.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:24.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:24.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:24.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:25.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:25.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:25.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:25.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:25.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:25.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:26.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:26.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:26.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:26.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:26.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:26.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:27.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:27.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:27.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:27.647+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:27.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:27.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:28.353 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:28.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:28.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:28.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:28.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:28.955+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:29.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:29.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:29.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:29.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:29.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:29.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:30.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:30.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:30.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:30.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:30.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:30.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:31.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:31.343+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:31.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:31.695+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:31.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:31.939+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:32.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:32.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:32.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:32.695+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:32.960 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:32.955+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:33.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:33.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:33.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:33.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:33.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:33.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:34.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:34.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:34.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:34.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:34.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:34.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:35.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:35.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:35.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:35.691+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:35.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:35.959+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:36.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:36.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:36.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:36.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:36.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:36.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:37.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:37.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:37.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:37.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:37.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:37.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:38.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:38.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:38.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:38.707+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:38.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:38.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:39.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:39.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:39.716 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:39.711+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:39.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:39.991+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:40.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:40.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:40.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:40.675+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:40.982 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:40.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:41.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:41.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:41.727 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:41.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:41.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:41.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:42.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:42.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:42.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:42.747+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:42.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:42.971+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:43.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:43.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:43.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:43.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:43.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:43.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:44.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:44.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:44.774 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:44.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:44.953 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:44.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:45.285 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:45.279+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:45.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:45.735+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:45.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:45.955+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:46.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:46.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:46.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:46.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:46.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:46.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:47.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:47.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:47.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:47.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:48.011 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:48.007+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:48.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:48.263+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:48.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:48.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:48.970 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:48.967+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:49.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:49.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:49.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:49.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:49.981 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:49.975+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:50.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:50.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:50.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:50.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:50.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:50.943+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:51.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:51.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:51.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:51.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:51.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:51.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:52.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:52.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:52.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:52.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:53.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:53.027+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:53.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:53.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:53.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:53.735+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:54.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:54.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:54.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:54.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:54.728 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:54.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:55.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:55.083+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:55.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:55.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:55.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:55.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:56.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:56.055+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:56.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:56.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:56.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:56.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:57.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:57.034+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:57.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:57.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:57.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:57.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:58.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:58.054+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:58.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:58.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:58.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:58.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:57:59.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:57:59.042+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:59.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:57:59.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:57:59.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:57:59.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:00.093 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:00.086+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:00.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:00.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:00.700 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:00.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:01.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:01.086+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:01.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:01.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:01.707 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:01.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:02.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:02.058+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:02.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:02.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:02.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:02.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:03.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:03.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:03.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:03.402+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:03.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:03.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:04.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:04.082+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:04.405 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:04.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:04.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:04.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:05.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:05.054+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:05.370 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:05.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:05.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:05.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:06.036 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:06.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:06.345 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:06.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:06.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:06.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:06.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:06.990+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:07.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:07.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:07.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:07.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:07.957 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:07.950+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:08.316 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:08.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:08.724 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:08.718+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:08.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:08.942+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:09.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:09.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:09.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:09.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:09.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:09.930+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:10.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:10.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:10.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:10.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:10.974 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:10.970+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:11.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:11.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:11.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:11.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:11.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:11.986+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:12.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:12.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:12.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:12.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:12.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:12.950+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:13.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:13.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:13.721 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:13.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:13.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:13.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:14.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:14.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:14.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:14.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:14.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:14.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:15.325 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:15.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:15.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:15.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:16.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:16.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:16.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:16.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:16.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:16.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:17.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:17.046+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:17.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:17.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:17.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:17.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:18.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:18.082+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:18.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:18.294+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:18.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:18.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:19.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:19.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:19.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:19.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:19.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:19.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:20.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:20.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:20.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:20.334+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:20.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:20.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:21.167 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:21.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:21.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:21.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:21.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:21.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:22.179 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:22.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:22.259 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:22.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:22.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:22.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:23.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:23.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:23.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:23.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:23.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:23.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:24.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:24.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:24.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:24.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:24.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:24.566+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:25.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:25.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:25.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:25.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:25.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:25.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:26.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:26.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:26.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:26.294+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:26.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:26.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:27.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:27.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:27.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:27.274+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:27.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:27.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:28.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:28.150+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:28.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:28.294+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:28.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:28.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:29.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:29.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:29.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:29.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:29.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:29.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:30.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:30.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:30.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:30.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:30.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:30.666+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:31.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:31.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:31.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:31.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:31.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:31.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:32.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:32.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:32.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:32.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:32.732 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:32.726+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:33.210 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:33.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:33.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:33.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:33.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:33.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:34.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:34.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:34.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:34.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:34.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:34.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:35.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:35.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:35.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:35.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:35.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:35.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:36.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:36.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:36.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:36.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:36.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:36.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:37.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:37.286+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:37.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:37.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:37.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:37.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:38.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:38.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:38.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:38.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:38.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:38.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:39.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:39.350+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:39.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:39.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:39.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:39.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:40.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:40.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:40.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:40.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:40.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:40.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:41.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:41.326+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:41.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:41.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:41.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:41.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:42.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:42.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:42.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:42.378+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:42.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:42.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:43.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:43.285+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:43.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:43.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:43.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:43.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:44.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:44.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:44.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:44.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:44.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:44.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:45.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:45.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:45.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:45.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:45.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:45.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:46.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:46.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:46.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:46.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:46.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:46.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:47.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:47.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:47.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:47.321+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:47.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:47.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:48.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:48.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:48.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:48.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:48.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:48.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:49.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:49.289+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:49.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:49.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:49.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:49.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:50.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:50.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:50.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:50.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:50.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:50.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:51.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:51.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:51.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:51.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:51.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:51.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:52.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:52.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:52.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:52.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:52.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:52.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:53.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:53.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:53.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:53.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:53.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:53.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:54.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:54.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:54.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:54.321+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:54.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:54.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:55.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:55.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:55.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:55.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:55.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:55.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:56.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:56.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:56.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:56.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:56.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:56.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:57.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:57.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:57.329 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:57.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:57.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:57.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:58.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:58.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:58.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:58.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:58.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:58.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:58:59.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:58:59.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:59.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:58:59.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:58:59.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:58:59.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:00.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:00.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:00.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:00.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:00.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:00.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:01.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:01.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:01.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:01.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:01.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:01.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:02.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:02.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:02.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:02.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:02.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:02.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:03.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:03.321+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:03.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:03.333+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:03.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:03.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:04.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:04.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:04.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:04.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:04.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:04.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:05.291 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:05.289+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:05.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:05.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:05.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:05.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:06.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:06.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:06.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:06.337+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:06.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:06.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:07.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:07.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:07.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:07.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:07.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:07.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:08.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:08.277+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:08.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:08.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:08.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:08.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:09.329 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:09.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:09.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:09.357+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:09.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:09.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:10.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:10.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:10.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:10.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:10.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:10.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:11.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:11.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:11.388 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:11.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:11.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:11.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:12.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:12.397+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:12.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:12.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:12.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:12.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:13.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:13.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:13.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:13.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:13.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:13.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:14.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:14.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:14.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:14.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:14.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:14.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:15.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:15.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:15.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:15.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:15.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:15.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:16.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:16.449+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:16.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:16.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:16.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:16.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:17.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:17.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:17.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:17.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:17.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:17.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:18.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:18.385+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:18.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:18.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:18.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:18.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:19.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:19.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:19.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:19.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:19.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:19.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:20.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:20.381+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:20.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:20.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:20.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:20.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:21.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:21.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:21.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:21.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:21.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:21.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:22.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:22.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:22.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:22.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:22.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:22.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:23.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:23.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:23.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:23.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:23.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:23.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:24.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:24.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:24.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:24.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:24.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:24.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:25.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:25.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:25.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:25.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:25.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:25.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:26.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:26.437+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:26.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:26.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:26.586 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:26.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:27.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:27.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:27.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:27.485+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:27.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:27.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:28.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:28.469+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:28.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:28.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:28.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:28.645+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:29.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:29.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:29.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:29.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:29.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:29.636+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:30.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:30.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:30.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:30.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:30.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:30.684+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:31.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:31.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:31.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:31.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:31.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:31.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:32.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:32.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:32.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:32.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:32.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:32.740+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:33.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:33.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:33.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:33.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:33.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:33.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:34.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:34.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:34.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:34.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:34.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:34.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:35.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:35.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:35.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:35.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:35.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:35.776+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:36.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:36.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:36.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:36.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:36.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:36.728+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:37.403 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:37.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:37.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:37.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:37.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:37.756+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:38.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:38.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:38.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:38.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:38.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:38.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:39.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:39.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:39.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:39.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:39.799 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:39.796+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:40.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:40.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:40.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:40.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:40.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:40.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:41.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:41.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:41.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:41.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:41.807 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:41.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:42.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:42.300+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:42.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:42.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:42.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:42.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:43.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:43.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:43.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:43.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:43.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:43.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:44.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:44.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:44.613 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:44.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:44.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:44.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:45.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:45.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:45.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:45.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:45.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:45.732+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:46.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:46.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:46.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:46.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:46.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:46.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:47.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:47.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:47.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:47.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:47.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:47.764+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:48.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:48.336+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:48.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:48.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:48.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:48.736+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:49.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:49.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:49.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:49.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:49.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:49.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:50.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:50.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:50.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:50.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:50.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:50.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:51.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:51.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:51.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:51.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:51.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:51.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:52.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:52.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:52.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:52.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:52.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:52.652+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:53.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:53.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:53.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:53.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:53.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:53.616+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:54.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:54.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:54.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:54.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:54.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:54.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:55.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:55.408+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:55.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:55.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:55.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:55.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:56.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:56.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:56.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:56.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:56.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:56.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:57.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:57.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:57.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:57.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:57.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:57.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:58.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:58.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:58.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:58.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:58.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:58.776+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:59.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T18:59:59.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T18:59:59.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T18:59:59.552+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T18:59:59.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T18:59:59.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:00.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:00.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:00.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:00.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:00.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:00.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:01.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:01.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:01.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:01.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:01.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:01.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:02.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:02.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:02.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:02.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:02.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:02.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:03.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:03.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:03.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:03.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:03.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:03.820+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:04.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:04.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:04.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:04.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:04.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:04.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:05.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:05.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:05.578 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:05.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:05.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:05.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:06.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:06.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:06.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:06.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:06.818 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:06.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:07.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:07.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:07.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:07.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:07.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:07.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:08.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:08.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:08.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:08.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:08.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:08.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:09.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:09.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:09.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:09.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:09.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:09.732+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:10.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:10.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:10.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:10.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:10.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:10.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:11.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:11.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:11.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:11.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:11.737 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:11.732+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:12.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:12.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:12.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:12.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:12.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:12.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:13.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:13.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:13.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:13.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:13.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:13.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:14.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:14.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:14.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:14.524+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:14.795 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:14.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:15.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:15.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:15.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:15.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:15.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:15.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:16.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:16.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:16.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:16.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:16.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:16.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:17.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:17.515+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:17.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:17.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:17.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:17.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:18.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:18.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:18.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:18.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:18.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:18.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:19.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:19.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:19.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:19.587+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:19.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:19.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:20.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:20.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:20.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:20.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:20.806 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:20.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:21.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:21.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:21.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:21.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:21.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:21.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:22.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:22.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:22.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:22.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:22.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:22.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:23.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:23.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:23.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:23.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:23.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:23.747+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:24.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:24.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:24.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:24.583+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:24.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:24.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:25.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:25.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:25.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:25.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:25.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:25.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:26.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:26.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:26.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:26.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:26.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:26.739+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:27.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:27.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:27.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:27.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:27.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:27.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:28.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:28.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:28.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:28.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:28.762 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:28.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:29.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:29.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:29.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:29.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:29.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:29.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:30.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:30.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:30.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:30.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:30.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:30.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:31.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:31.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:31.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:31.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:31.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:31.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:32.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:32.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:32.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:32.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:32.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:32.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:33.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:33.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:33.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:33.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:33.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:33.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:34.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:34.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:34.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:34.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:34.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:34.783+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:35.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:35.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:35.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:35.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:35.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:35.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:36.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:36.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:36.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:36.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:36.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:36.823+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:37.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:37.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:37.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:37.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:37.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:37.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:38.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:38.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:38.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:38.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:38.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:38.811+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:39.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:39.619+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:39.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:39.655+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:39.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:39.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:40.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:40.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:40.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:40.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:40.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:40.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:41.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:41.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:41.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:41.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:41.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:41.771+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:42.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:42.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:42.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:42.655+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:42.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:42.823+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:43.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:43.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:43.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:43.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:43.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:43.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:44.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:44.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:44.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:44.635+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:44.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:44.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:45.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:45.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:45.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:45.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:45.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:45.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:46.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:46.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:46.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:46.663+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:46.853 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:46.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:47.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:47.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:47.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:47.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:47.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:47.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:48.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:48.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:48.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:48.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:48.832 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:48.827+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:49.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:49.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:49.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:49.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:49.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:49.803+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:50.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:50.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:50.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:50.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:50.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:50.839+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:51.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:51.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:51.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:51.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:51.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:51.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:52.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:52.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:52.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:52.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:52.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:52.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:53.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:53.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:53.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:53.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:53.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:53.827+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:54.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:54.615+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:54.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:54.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:54.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:54.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:55.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:55.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:55.657 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:55.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:55.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:55.823+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:56.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:56.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:56.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:56.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:56.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:56.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:57.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:57.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:57.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:57.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:57.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:57.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:58.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:58.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:58.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:58.679+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:58.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:58.851+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:59.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:00:59.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:00:59.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:00:59.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:00:59.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:00:59.827+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:00.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:00.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:00.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:00.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:00.817 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:00.811+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:01.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:01.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:01.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:01.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:01.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:01.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:02.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:02.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:02.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:02.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:02.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:02.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:03.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:03.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:03.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:03.698+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:03.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:03.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:04.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:04.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:04.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:04.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:04.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:04.818+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:05.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:05.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:05.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:05.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:05.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:05.854+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:06.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:06.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:06.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:06.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:06.854 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:06.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:07.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:07.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:07.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:07.798+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:07.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:07.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:08.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:08.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:08.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:08.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:08.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:08.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:09.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:09.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:09.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:09.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:09.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:09.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:10.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:10.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:10.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:10.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:10.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:10.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:11.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:11.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:11.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:11.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:11.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:11.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:12.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:12.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:12.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:12.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:12.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:12.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:13.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:13.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:13.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:13.718+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:13.764 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:13.758+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:14.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:14.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:14.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:14.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:14.796 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:14.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:15.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:15.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:15.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:15.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:15.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:15.814+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:16.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:16.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:16.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:16.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:16.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:16.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:17.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:17.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:17.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:17.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:17.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:17.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:18.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:18.714+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:18.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:18.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:18.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:18.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:19.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:19.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:19.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:19.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:19.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:19.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:20.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:20.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:20.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:20.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:20.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:20.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:21.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:21.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:21.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:21.718+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:21.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:21.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:22.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:22.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:22.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:22.706+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:22.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:22.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:23.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:23.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:23.746 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:23.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:23.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:23.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:24.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:24.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:24.699 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:24.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:24.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:24.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:25.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:25.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:25.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:25.718+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:25.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:25.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:26.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:26.646+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:26.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:26.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:26.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:26.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:27.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:27.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:27.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:27.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:27.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:27.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:28.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:28.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:28.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:28.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:28.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:28.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:29.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:29.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:29.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:29.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:29.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:29.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:30.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:30.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:30.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:30.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:30.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:30.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:31.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:31.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:31.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:31.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:31.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:31.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:32.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:32.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:32.740 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:32.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:32.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:32.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:33.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:33.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:33.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:33.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:33.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:33.874+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:34.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:34.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:34.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:34.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:34.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:34.878+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:35.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:35.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:35.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:35.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:35.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:35.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:36.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:36.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:36.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:36.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:36.912 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:36.906+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:37.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:37.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:37.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:37.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:37.949 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:37.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:38.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:38.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:38.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:38.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:38.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:38.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:39.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:39.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:39.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:39.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:39.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:39.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:40.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:40.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:40.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:40.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:40.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:40.942+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:41.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:41.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:41.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:41.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:41.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:41.974+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:42.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:42.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:42.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:42.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:42.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:42.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:43.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:43.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:43.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:43.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:44.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:43.998+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:44.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:44.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:44.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:44.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:45.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:45.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:45.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:45.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:45.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:45.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:46.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:46.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:46.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:46.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:46.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:46.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:47.017 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:47.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:47.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:47.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:47.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:47.621+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:48.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:47.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:48.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:48.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:48.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:48.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:49.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:49.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:49.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:49.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:49.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:49.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:50.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:50.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:50.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:50.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:50.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:50.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:51.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:51.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:51.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:51.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:51.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:51.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:52.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:52.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:52.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:52.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:52.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:52.705+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:53.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:53.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:53.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:53.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:53.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:53.737+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:54.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:53.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:54.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:54.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:54.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:54.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:54.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:54.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:55.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:55.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:55.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:55.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:56.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:56.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:56.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:56.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:56.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:56.773+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:56.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:56.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:57.578 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:57.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:57.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:57.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:57.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:57.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:58.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:58.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:58.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:58.785+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:58.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:58.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:59.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:01:59.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:01:59.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:01:59.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:01:59.916 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:01:59.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:00.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:00.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:00.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:00.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:00.938 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:00.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:01.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:01.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:01.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:01.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:01.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:01.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:02.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:02.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:02.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:02.761+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:02.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:02.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:03.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:03.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:03.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:03.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:04.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:04.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:04.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:04.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:04.774 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:04.773+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:05.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:05.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:05.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:05.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:05.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:05.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:06.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:06.061+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:06.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:06.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:06.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:06.753+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:07.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:07.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:07.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:07.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:07.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:07.773+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:08.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:08.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:08.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:08.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:08.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:08.781+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:08.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:08.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:09.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:09.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:09.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:09.757+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:10.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:10.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:10.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:10.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:10.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:10.705+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:10.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:10.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:11.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:11.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:11.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:11.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:11.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:11.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:12.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:12.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:12.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:12.657+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:12.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:12.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:13.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:13.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:13.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:13.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:13.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:13.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:14.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:14.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:14.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:14.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:15.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:15.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:15.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:15.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:15.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:15.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:15.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:15.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:16.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:16.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:16.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:16.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:16.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:16.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:17.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:17.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:17.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:17.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:17.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:17.925+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:18.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:18.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:18.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:18.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:18.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:18.921+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:19.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:19.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:19.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:19.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:19.974 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:19.973+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:20.664 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:20.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:20.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:20.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:20.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:20.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:21.654 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:21.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:21.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:21.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:22.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:21.997+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:22.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:22.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:22.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:22.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:23.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:23.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:23.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:23.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:23.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:23.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:24.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:24.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:24.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:24.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:24.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:24.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:25.039 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:25.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:25.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:25.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:25.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:25.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:26.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:26.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:26.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:26.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:26.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:26.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:27.029 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:27.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:27.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:27.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:27.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:27.625+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:27.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:27.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:28.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:28.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:28.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:28.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:28.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:28.985+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:29.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:29.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:29.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:29.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:29.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:29.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:30.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:30.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:30.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:30.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:30.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:30.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:31.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:31.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:31.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:31.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:31.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:31.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:32.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:32.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:32.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:32.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:32.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:32.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:33.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:33.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:33.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:33.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:34.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:34.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:34.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:34.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:34.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:34.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:35.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:35.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:35.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:35.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:35.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:35.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:36.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:36.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:36.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:36.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:36.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:36.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:37.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:37.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:37.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:37.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:37.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:37.564+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:38.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:38.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:38.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:38.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:38.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:38.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:39.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:39.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:39.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:39.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:39.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:39.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:40.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:40.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:40.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:40.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:40.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:40.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:41.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:41.032+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:41.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:41.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:41.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:41.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:42.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:41.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:42.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:42.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:42.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:42.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:42.981 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:42.976+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:43.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:43.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:43.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:43.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:43.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:43.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:44.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:44.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:44.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:44.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:44.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:44.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:45.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:45.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:45.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:45.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:45.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:45.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:46.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:46.524+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:46.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:46.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:46.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:46.936+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:47.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:47.552+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:47.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:47.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:47.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:47.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:48.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:48.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:48.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:48.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:48.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:48.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:49.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:49.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:49.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:49.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:49.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:49.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:50.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:50.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:50.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:50.636+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:51.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:51.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:51.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:51.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:51.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:51.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:52.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:52.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:52.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:52.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:52.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:52.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:53.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:53.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:53.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:53.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:53.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:53.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:54.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:54.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:54.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:54.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:54.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:54.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:54.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:54.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:55.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:55.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:55.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:55.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:55.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:55.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:56.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:56.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:56.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:56.668+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:56.911 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:56.908+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:57.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:57.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:57.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:57.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:57.949 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:57.944+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:58.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:58.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:58.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:58.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:58.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:58.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:59.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:02:59.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:02:59.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:02:59.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:02:59.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:02:59.936+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:00.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:00.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:00.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:00.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:00.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:00.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:01.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:01.504+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:01.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:01.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:01.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:01.968+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:02.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:02.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:02.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:02.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:02.953 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:02.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:03.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:03.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:03.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:03.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:03.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:03.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:04.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:04.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:04.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:04.780+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:04.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:04.972+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:05.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:05.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:05.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:05.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:06.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:05.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:06.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:06.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:06.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:06.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:07.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:07.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:07.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:07.504+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:07.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:07.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:08.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:08.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:08.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:08.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:08.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:08.708+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:09.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:09.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:09.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:09.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:09.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:09.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:10.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:10.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:10.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:10.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:10.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:10.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:11.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:11.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:11.519 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:11.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:11.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:11.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:12.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:12.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:12.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:12.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:12.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:12.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:13.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:13.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:13.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:13.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:13.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:13.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:14.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:14.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:14.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:14.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:14.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:14.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:15.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:15.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:15.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:15.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:15.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:15.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:16.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:16.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:16.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:16.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:16.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:16.780+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:17.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:17.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:17.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:17.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:17.837 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:17.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:18.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:18.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:18.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:18.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:18.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:18.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:19.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:19.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:19.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:19.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:19.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:19.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:20.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:20.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:20.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:20.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:20.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:20.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:21.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:21.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:21.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:21.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:21.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:21.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:22.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:22.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:22.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:22.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:22.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:22.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:23.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:23.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:23.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:23.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:23.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:23.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:24.241 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:24.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:24.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:24.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:24.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:24.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:25.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:25.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:25.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:25.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:25.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:25.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:26.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:26.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:26.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:26.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:26.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:26.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:27.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:27.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:27.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:27.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:27.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:27.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:28.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:28.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:28.446 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:28.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:28.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:28.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:29.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:29.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:29.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:29.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:29.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:29.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:30.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:30.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:30.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:30.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:30.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:30.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:31.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:31.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:31.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:31.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:31.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:31.735+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:32.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:32.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:32.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:32.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:32.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:32.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:33.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:33.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:33.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:33.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:33.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:33.727+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:34.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:34.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:34.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:34.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:34.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:34.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:35.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:35.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:35.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:35.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:35.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:35.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:36.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:36.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:36.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:36.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:36.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:36.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:37.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:37.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:37.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:37.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:37.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:37.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:38.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:38.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:38.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:38.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:38.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:38.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:39.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:39.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:39.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:39.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:39.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:39.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:40.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:40.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:40.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:40.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:40.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:40.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:41.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:41.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:41.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:41.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:41.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:41.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:42.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:42.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:42.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:42.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:42.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:42.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:43.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:43.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:43.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:43.499+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:43.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:43.651+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:44.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:44.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:44.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:44.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:44.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:44.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:45.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:45.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:45.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:45.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:45.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:45.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:46.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:46.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:46.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:46.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:46.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:46.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:47.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:47.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:47.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:47.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:47.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:47.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:48.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:48.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:48.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:48.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:48.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:48.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:49.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:49.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:49.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:49.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:49.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:49.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:50.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:50.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:50.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:50.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:50.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:50.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:51.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:51.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:51.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:51.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:51.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:51.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:52.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:52.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:52.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:52.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:52.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:52.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:53.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:53.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:53.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:53.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:53.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:53.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:54.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:54.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:54.427 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:54.423+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:54.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:54.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:55.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:55.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:55.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:55.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:55.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:55.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:56.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:56.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:56.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:56.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:56.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:56.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:57.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:57.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:57.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:57.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:57.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:57.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:58.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:58.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:58.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:58.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:58.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:58.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:59.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:03:59.355+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:03:59.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:03:59.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:03:59.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:03:59.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:00.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:00.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:00.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:00.423+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:00.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:00.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:01.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:01.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:01.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:01.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:01.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:01.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:02.442 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:02.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:02.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:02.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:02.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:02.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:03.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:03.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:03.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:03.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:03.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:03.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:04.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:04.439+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:04.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:04.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:04.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:04.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:05.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:05.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:05.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:05.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:05.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:05.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:06.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:06.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:06.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:06.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:06.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:06.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:07.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:07.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:07.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:07.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:07.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:07.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:08.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:08.398+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:08.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:08.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:08.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:08.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:09.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:09.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:09.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:09.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:09.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:09.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:10.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:10.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:10.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:10.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:10.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:10.714+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:11.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:11.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:11.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:11.562+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:11.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:11.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:12.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:12.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:12.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:12.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:12.683 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:12.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:13.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:13.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:13.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:13.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:13.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:13.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:14.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:14.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:14.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:14.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:14.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:14.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:15.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:15.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:15.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:15.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:15.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:15.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:16.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:16.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:16.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:16.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:16.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:16.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:17.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:17.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:17.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:17.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:17.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:17.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:18.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:18.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:18.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:18.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:18.711 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:18.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:19.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:19.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:19.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:19.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:19.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:19.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:20.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:20.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:20.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:20.542+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:20.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:20.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:21.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:21.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:21.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:21.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:21.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:21.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:22.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:22.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:22.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:22.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:22.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:22.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:23.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:23.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:23.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:23.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:23.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:23.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:24.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:24.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:24.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:24.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:24.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:24.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:25.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:25.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:25.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:25.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:25.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:25.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:26.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:26.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:26.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:26.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:26.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:26.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:27.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:27.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:27.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:27.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:27.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:27.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:28.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:28.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:28.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:28.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:28.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:28.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:29.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:29.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:29.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:29.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:29.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:29.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:30.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:30.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:30.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:30.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:30.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:30.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:31.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:31.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:31.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:31.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:31.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:31.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:32.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:32.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:32.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:32.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:32.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:32.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:33.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:33.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:33.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:33.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:33.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:33.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:34.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:34.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:34.485 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:34.478+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:34.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:34.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:35.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:35.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:35.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:35.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:35.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:35.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:36.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:36.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:36.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:36.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:36.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:36.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:37.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:37.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:37.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:37.478+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:37.566 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:37.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:38.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:38.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:38.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:38.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:38.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:38.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:39.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:39.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:39.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:39.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:39.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:39.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:40.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:40.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:40.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:40.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:40.566 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:40.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:41.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:41.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:41.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:41.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:41.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:41.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:42.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:42.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:42.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:42.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:42.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:42.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:43.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:43.102+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:43.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:43.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:43.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:43.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:44.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:44.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:44.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:44.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:44.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:44.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:45.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:45.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:45.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:45.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:45.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:45.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:46.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:46.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:46.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:46.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:46.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:46.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:47.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:47.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:47.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:47.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:47.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:47.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:48.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:48.182+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:48.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:48.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:48.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:48.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:49.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:49.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:49.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:49.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:49.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:49.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:50.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:50.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:50.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:50.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:50.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:50.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:51.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:51.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:51.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:51.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:51.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:51.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:52.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:52.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:52.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:52.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:52.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:52.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:53.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:53.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:53.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:53.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:53.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:53.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:54.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:54.121+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:54.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:54.469+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:54.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:54.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:55.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:55.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:55.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:55.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:55.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:55.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:56.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:56.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:56.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:56.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:56.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:56.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:57.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:57.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:57.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:57.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:57.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:57.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:58.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:58.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:58.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:58.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:58.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:58.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:59.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:04:59.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:04:59.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:04:59.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:04:59.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:04:59.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:00.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:00.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:00.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:00.429+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:00.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:00.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:01.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:01.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:01.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:01.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:01.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:01.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:02.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:02.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:02.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:02.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:02.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:02.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:03.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:03.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:03.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:03.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:03.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:03.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:04.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:04.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:04.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:04.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:04.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:04.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:05.033 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:05.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:05.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:05.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:05.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:05.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:06.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:06.049+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:06.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:06.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:06.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:06.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:07.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:07.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:07.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:07.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:07.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:07.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:08.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:08.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:08.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:08.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:08.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:08.529+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:09.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:09.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:09.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:09.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:09.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:09.529+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:10.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:10.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:10.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:10.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:10.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:10.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:11.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:11.121+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:11.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:11.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:11.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:11.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:12.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:12.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:12.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:12.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:12.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:12.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:13.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:13.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:13.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:13.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:13.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:13.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:14.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:14.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:14.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:14.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:14.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:14.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:15.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:15.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:15.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:15.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:15.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:15.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:16.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:16.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:16.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:16.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:16.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:16.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:17.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:17.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:17.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:17.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:17.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:17.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:18.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:18.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:18.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:18.357+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:18.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:18.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:19.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:19.265+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:19.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:19.357+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:19.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:19.437+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:20.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:20.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:20.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:20.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:20.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:20.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:21.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:21.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:21.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:21.337+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:21.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:21.425+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:22.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:22.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:22.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:22.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:22.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:22.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:23.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:23.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:23.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:23.413+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:23.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:23.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:24.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:24.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:24.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:24.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:24.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:24.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:25.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:25.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:25.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:25.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:25.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:25.453+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:26.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:26.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:26.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:26.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:26.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:26.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:27.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:27.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:27.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:27.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:27.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:27.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:28.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:28.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:28.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:28.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:28.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:28.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:29.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:29.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:29.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:29.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:29.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:29.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:30.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:30.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:30.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:30.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:30.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:30.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:31.104 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:31.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:31.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:31.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:31.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:31.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:32.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:32.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:32.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:32.493+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:32.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:32.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:33.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:33.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:33.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:33.453+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:33.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:33.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:34.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:34.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:34.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:34.457+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:34.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:34.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:35.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:35.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:35.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:35.445+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:35.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:35.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:36.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:36.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:36.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:36.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:36.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:36.457+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:37.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:37.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:37.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:37.429+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:37.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:37.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:38.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:38.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:38.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:38.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:38.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:38.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:39.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:39.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:39.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:39.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:39.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:39.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:40.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:40.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:40.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:40.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:40.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:40.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:41.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:41.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:41.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:41.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:41.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:41.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:42.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:42.148+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:42.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:42.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:42.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:42.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:43.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:43.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:43.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:43.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:43.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:43.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:44.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:44.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:44.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:44.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:44.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:44.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:45.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:45.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:45.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:45.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:45.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:45.404+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:46.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:46.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:46.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:46.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:46.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:46.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:47.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:47.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:47.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:47.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:47.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:47.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:48.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:48.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:48.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:48.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:48.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:48.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:49.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:49.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:49.313 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:49.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:49.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:49.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:50.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:50.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:50.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:50.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:50.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:50.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:51.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:51.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:51.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:51.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:51.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:51.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:52.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:52.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:52.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:52.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:52.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:52.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:53.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:53.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:53.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:53.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:53.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:53.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:54.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:54.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:54.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:54.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:54.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:54.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:55.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:55.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:55.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:55.180+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:55.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:55.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:56.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:56.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:56.209 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:56.204+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:56.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:56.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:57.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:57.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:57.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:57.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:57.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:57.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:58.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:58.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:58.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:58.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:58.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:58.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:05:59.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:05:59.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:59.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:05:59.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:05:59.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:05:59.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:00.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:00.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:00.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:00.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:00.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:00.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:01.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:01.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:01.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:01.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:01.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:01.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:02.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:02.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:02.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:02.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:02.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:02.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:03.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:03.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:03.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:03.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:03.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:03.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:04.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:04.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:04.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:04.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:04.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:04.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:05.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:05.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:05.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:05.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:05.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:05.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:06.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:06.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:06.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:06.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:06.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:06.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:07.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:07.024+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:07.249 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:07.244+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:07.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:07.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:08.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:08.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:08.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:08.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:08.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:08.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:09.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:09.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:09.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:09.308+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:09.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:09.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:10.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:10.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:10.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:10.340+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:10.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:10.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:11.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:11.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:11.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:11.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:11.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:11.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:12.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:12.112+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:12.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:12.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:12.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:12.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:13.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:13.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:13.330 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:13.328+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:13.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:13.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:14.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:14.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:14.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:14.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:14.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:14.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:15.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:15.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:15.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:15.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:15.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:15.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:16.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:16.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:16.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:16.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:16.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:16.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:17.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:17.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:17.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:17.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:17.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:17.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:18.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:18.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:18.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:18.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:18.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:18.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:19.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:19.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:19.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:19.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:19.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:19.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:20.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:20.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:20.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:20.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:20.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:20.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:21.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:21.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:21.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:21.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:21.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:21.520+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:22.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:22.112+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:22.428 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:22.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:22.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:22.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:23.103 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:23.100+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:23.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:23.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:23.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:23.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:24.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:24.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:24.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:24.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:24.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:24.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:25.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:25.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:25.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:25.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:25.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:25.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:26.105 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:26.099+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:26.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:26.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:26.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:26.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:27.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:27.059+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:27.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:27.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:27.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:27.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:28.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:28.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:28.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:28.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:28.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:28.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:29.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:29.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:29.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:29.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:29.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:29.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:30.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:30.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:30.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:30.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:30.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:30.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:31.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:31.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:31.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:31.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:31.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:31.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:32.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:32.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:32.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:32.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:32.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:32.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:33.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:33.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:33.426 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:33.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:33.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:33.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:34.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:34.047+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:34.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:34.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:34.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:34.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:35.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:35.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:35.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:35.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:35.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:35.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:36.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:36.007+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:36.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:36.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:36.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:36.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:36.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:36.987+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:37.407 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:37.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:37.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:37.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:38.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:38.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:38.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:38.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:38.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:38.423+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:38.996 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:38.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:39.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:39.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:39.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:39.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:40.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:40.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:40.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:40.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:40.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:40.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:41.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:41.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:41.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:41.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:41.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:41.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:42.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:42.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:42.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:42.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:42.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:42.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:43.094 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:43.087+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:43.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:43.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:43.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:43.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:44.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:44.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:44.455 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:44.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:44.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:44.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:45.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:45.039+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:45.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:45.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:45.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:45.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:46.047 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:46.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:46.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:46.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:46.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:46.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:47.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:47.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:47.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:47.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:47.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:47.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:48.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:48.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:48.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:48.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:48.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:48.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:49.038 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:49.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:49.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:49.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:49.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:49.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:50.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:50.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:50.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:50.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:50.415 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:50.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:51.023 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:51.019+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:51.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:51.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:51.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:51.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:51.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:51.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:52.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:52.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:52.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:52.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:52.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:52.943+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:53.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:53.403+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:53.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:53.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:53.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:53.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:54.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:54.395+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:54.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:54.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:54.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:54.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:55.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:55.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:55.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:55.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:55.898 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:55.891+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:56.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:56.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:56.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:56.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:56.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:56.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:57.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:57.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:57.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:57.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:57.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:57.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:58.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:58.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:58.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:58.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:58.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:58.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:59.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:06:59.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:06:59.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:06:59.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:06:59.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:06:59.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:00.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:00.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:00.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:00.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:00.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:00.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:01.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:01.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:01.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:01.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:01.938 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:01.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:02.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:02.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:02.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:02.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:02.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:02.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:03.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:03.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:03.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:03.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:03.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:03.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:04.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:04.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:04.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:04.567+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:04.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:04.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:05.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:05.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:05.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:05.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:05.937 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:05.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:06.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:06.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:06.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:06.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:06.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:06.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:07.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:07.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:07.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:07.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:08.040 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:08.035+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:08.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:08.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:08.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:08.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:09.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:09.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:09.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:09.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:09.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:09.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:10.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:10.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:10.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:10.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:10.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:10.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:11.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:11.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:11.269 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:11.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:11.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:11.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:12.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:12.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:12.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:12.314+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:12.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:12.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:13.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:12.994+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:13.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:13.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:13.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:13.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:13.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:13.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:14.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:14.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:14.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:14.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:14.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:14.966+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:15.265 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:15.258+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:15.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:15.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:15.956 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:15.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:16.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:16.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:16.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:16.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:16.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:16.978+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:17.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:17.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:17.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:17.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:18.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:18.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:18.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:18.238+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:18.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:18.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:19.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:19.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:19.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:19.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:19.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:19.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:20.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:20.034+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:20.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:20.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:20.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:20.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:21.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:21.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:21.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:21.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:21.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:21.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:22.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:22.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:22.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:22.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:22.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:22.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:23.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:23.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:23.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:23.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:23.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:23.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:24.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:24.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:24.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:24.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:24.566 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:24.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:25.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:25.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:25.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:25.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:25.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:25.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:26.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:25.994+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:26.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:26.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:26.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:26.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:26.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:26.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:27.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:27.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:27.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:27.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:27.964 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:27.958+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:28.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:28.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:28.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:28.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:28.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:28.990+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:29.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:29.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:29.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:29.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:29.985 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:29.978+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:30.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:30.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:30.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:30.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:30.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:30.990+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:31.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:31.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:31.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:31.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:32.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:32.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:32.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:32.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:32.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:32.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:32.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:32.978+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:33.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:33.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:33.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:33.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:34.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:34.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:34.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:34.390+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:34.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:34.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:35.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:35.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:35.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:35.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:35.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:35.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:36.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:36.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:36.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:36.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:36.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:36.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:37.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:37.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:37.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:37.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:37.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:37.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:38.030 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:38.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:38.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:38.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:38.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:38.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:39.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:39.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:39.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:39.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:39.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:39.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:40.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:40.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:40.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:40.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:40.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:40.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:41.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:41.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:41.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:41.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:41.693 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:41.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:42.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:42.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:42.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:42.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:42.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:42.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:43.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:43.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:43.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:43.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:43.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:43.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:44.013 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:44.006+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:44.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:44.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:44.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:44.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:45.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:45.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:45.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:45.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:45.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:45.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:45.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:45.974+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:46.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:46.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:46.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:46.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:47.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:47.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:47.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:47.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:47.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:47.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:48.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:48.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:48.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:48.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:48.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:48.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:49.025 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:49.018+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:49.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:49.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:49.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:49.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:50.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:50.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:50.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:50.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:50.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:50.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:51.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:51.042+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:51.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:51.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:51.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:51.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:52.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:52.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:52.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:52.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:52.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:52.706+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:53.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:53.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:53.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:53.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:53.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:53.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:54.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:54.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:54.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:54.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:54.740 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:54.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:55.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:55.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:55.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:55.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:55.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:55.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:56.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:56.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:56.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:56.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:56.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:56.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:57.115 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:57.109+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:57.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:57.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:57.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:57.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:58.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:58.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:58.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:58.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:58.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:58.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:59.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:07:59.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:07:59.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:07:59.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:07:59.771 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:07:59.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:00.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:00.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:00.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:00.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:00.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:00.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:01.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:01.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:01.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:01.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:01.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:01.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:02.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:02.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:02.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:02.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:02.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:02.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:03.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:03.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:03.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:03.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:03.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:03.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:04.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:04.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:04.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:04.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:04.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:04.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:05.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:05.081+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:05.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:05.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:05.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:05.805+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:06.056 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:06.049+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:06.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:06.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:06.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:06.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:07.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:07.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:07.708 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:07.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:07.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:07.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:08.070 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:08.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:08.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:08.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:08.868 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:08.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:09.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:09.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:09.701 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:09.697+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:09.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:09.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:10.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:10.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:10.735 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:10.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:10.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:10.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:11.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:11.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:11.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:11.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:11.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:11.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:12.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:12.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:12.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:12.749+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:12.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:12.873+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:13.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:13.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:13.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:13.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:13.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:13.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:14.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:14.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:14.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:14.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:14.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:14.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:15.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:15.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:15.779 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:15.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:15.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:15.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:16.087 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:16.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:16.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:16.793+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:16.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:16.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:17.076 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:17.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:17.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:17.845+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:17.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:17.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:18.079 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:18.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:18.809 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:18.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:18.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:18.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:19.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:19.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:19.773 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:19.769+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:19.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:19.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:20.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:20.061+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:20.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:20.749+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:20.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:20.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:21.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:21.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:21.723 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:21.721+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:21.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:21.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:22.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:22.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:22.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:22.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:22.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:22.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:23.106 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:23.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:23.717 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:23.713+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:23.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:23.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:24.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:24.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:24.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:24.757+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:24.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:24.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:25.072 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:25.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:25.801 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:25.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:25.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:25.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:26.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:26.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:26.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:26.801+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:26.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:26.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:27.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:27.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:27.791 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:27.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:27.834 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:27.833+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:28.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:28.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:28.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:28.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:28.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:28.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:29.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:29.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:29.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:29.741+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:29.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:29.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:30.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:30.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:30.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:30.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:30.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:30.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:31.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:31.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:31.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:31.757+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:31.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:31.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:32.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:32.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:32.807 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:32.805+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:32.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:32.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:33.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:33.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:33.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:33.801+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:33.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:33.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:34.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:34.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:34.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:34.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:34.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:34.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:35.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:35.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:35.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:35.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:35.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:35.885+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:36.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:36.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:36.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:36.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:36.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:36.873+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:37.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:37.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:37.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:37.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:37.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:37.881+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:38.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:38.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:38.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:38.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:38.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:38.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:39.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:39.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:39.870 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:39.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:39.907 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:39.905+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:40.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:40.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:40.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:40.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:40.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:40.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:41.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:41.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:41.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:41.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:41.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:41.933+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:42.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:42.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:42.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:42.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:42.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:42.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:43.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:43.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:43.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:43.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:44.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:44.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:44.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:44.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:44.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:44.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:45.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:45.068+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:45.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:45.236+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:45.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:45.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:46.078 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:46.076+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:46.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:46.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:46.858 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:46.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:47.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:47.028+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:47.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:47.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:47.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:47.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:48.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:48.016+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:48.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:48.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:48.902 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:48.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:49.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:49.012+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:49.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:49.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:49.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:49.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:50.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:50.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:50.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:50.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:50.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:50.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:51.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:51.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:51.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:51.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:51.899 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:51.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:51.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:51.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:52.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:52.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:52.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:52.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:52.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:52.952+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:53.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:53.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:53.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:53.860+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:53.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:53.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:54.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:54.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:54.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:54.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:54.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:54.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:55.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:55.244+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:55.814 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:55.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:55.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:55.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:56.281 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:56.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:56.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:56.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:56.905 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:56.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:57.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:57.324+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:57.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:57.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:57.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:57.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:58.363 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:58.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:58.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:58.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:58.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:58.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:08:59.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:08:59.376+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:59.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:08:59.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:08:59.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:08:59.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:00.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:00.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:00.816 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:00.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:00.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:00.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:01.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:01.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:01.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:01.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:01.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:01.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:02.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:02.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:02.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:02.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:02.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:02.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:03.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:03.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:03.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:03.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:03.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:03.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:04.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:04.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:04.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:04.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:04.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:04.928+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:05.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:05.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:05.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:05.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:05.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:05.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:06.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:06.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:06.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:06.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:06.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:06.964+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:07.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:07.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:07.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:07.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:07.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:07.916+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:08.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:08.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:08.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:08.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:08.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:08.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:09.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:09.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:09.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:09.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:09.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:09.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:10.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:10.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:10.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:10.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:10.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:10.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:11.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:11.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:11.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:11.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:11.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:11.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:12.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:12.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:12.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:12.772+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:12.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:12.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:13.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:13.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:13.808 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:13.804+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:13.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:13.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:14.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:14.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:14.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:14.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:14.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:14.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:15.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:15.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:15.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:15.836+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:15.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:15.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:16.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:16.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:16.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:16.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:16.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:16.884+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:17.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:17.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:17.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:17.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:17.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:17.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:18.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:18.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:18.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:18.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:18.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:18.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:19.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:19.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:19.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:19.736+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:19.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:19.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:20.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:20.536+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:20.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:20.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:20.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:20.788+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:21.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:21.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:21.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:21.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:21.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:21.776+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:22.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:22.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:22.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:22.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:22.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:22.756+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:23.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:23.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:23.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:23.788+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:23.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:23.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:24.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:24.536+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:24.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:24.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:24.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:24.800+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:25.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:25.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:25.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:25.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:25.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:25.788+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:26.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:26.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:26.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:26.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:26.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:26.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:27.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:27.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:27.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:27.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:27.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:27.764+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:28.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:28.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:28.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:28.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:28.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:28.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:29.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:29.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:29.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:29.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:29.809 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:29.803+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:30.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:30.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:30.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:30.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:30.764 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:30.759+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:31.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:31.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:31.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:31.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:31.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:31.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:32.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:32.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:32.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:32.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:32.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:32.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:33.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:33.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:33.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:33.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:33.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:33.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:34.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:34.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:34.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:34.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:34.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:34.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:35.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:35.439+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:35.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:35.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:35.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:35.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:36.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:36.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:36.683 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:36.679+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:36.801 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:36.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:37.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:37.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:37.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:37.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:37.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:37.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:38.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:38.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:38.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:38.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:38.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:38.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:39.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:39.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:39.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:39.747+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:39.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:39.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:40.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:40.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:40.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:40.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:40.773 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:40.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:41.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:41.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:41.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:41.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:41.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:41.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:42.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:42.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:42.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:42.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:42.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:42.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:43.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:43.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:43.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:43.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:43.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:43.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:44.356 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:44.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:44.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:44.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:44.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:44.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:45.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:45.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:45.747 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:45.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:45.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:45.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:46.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:46.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:46.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:46.695+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:46.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:46.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:47.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:47.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:47.707 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:47.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:47.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:47.767+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:48.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:48.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:48.750 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:48.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:48.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:48.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:49.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:49.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:49.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:49.787+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:49.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:49.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:50.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:50.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:50.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:50.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:50.865 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:50.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:51.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:51.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:51.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:51.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:51.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:51.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:52.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:52.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:52.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:52.727+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:52.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:52.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:53.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:53.419+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:53.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:53.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:53.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:53.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:54.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:54.387+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:54.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:54.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:54.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:54.915+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:55.408 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:55.403+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:55.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:55.823+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:55.928 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:55.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:56.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:56.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:56.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:56.847+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:56.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:56.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:57.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:57.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:57.882 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:57.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:57.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:57.883+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:58.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:58.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:58.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:58.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:09:58.913 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:58.907+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:59.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:09:59.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:59.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:09:59.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:09:59.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:09:59.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:00.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:00.475+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:00.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:00.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:00.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:00.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:01.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:01.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:01.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:01.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:01.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:01.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:02.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:02.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:02.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:02.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:02.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:02.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:03.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:03.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:03.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:03.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:03.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:03.907+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:04.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:04.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:04.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:04.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:04.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:04.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:05.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:05.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:05.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:05.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:05.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:05.939+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:06.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:06.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:06.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:06.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:06.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:06.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:07.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:07.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:07.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:07.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:07.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:07.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:08.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:08.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:08.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:08.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:08.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:08.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:09.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:09.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:09.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:09.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:09.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:09.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:10.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:10.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:10.748 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:10.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:10.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:10.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:11.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:11.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:11.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:11.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:11.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:11.863+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:12.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:12.563+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:12.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:12.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:12.840 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:12.835+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:13.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:13.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:13.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:13.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:13.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:13.867+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:14.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:14.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:14.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:14.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:14.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:14.887+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:15.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:15.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:15.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:15.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:15.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:15.838+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:16.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:16.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:16.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:16.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:16.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:16.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:17.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:17.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:17.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:17.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:17.795 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:17.790+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:18.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:18.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:18.794 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:18.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:18.809 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:18.802+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:19.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:19.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:19.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:19.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:19.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:19.790+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:20.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:20.370+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:20.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:20.770+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:20.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:20.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:21.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:21.422+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:21.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:21.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:21.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:21.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:22.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:22.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:22.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:22.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:22.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:22.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:23.443 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:23.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:23.736 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:23.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:23.791 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:23.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:24.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:24.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:24.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:24.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:24.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:24.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:25.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:25.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:25.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:25.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:25.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:25.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:26.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:26.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:26.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:26.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:26.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:26.678+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:27.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:27.442+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:27.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:27.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:27.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:27.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:28.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:28.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:28.712 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:28.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:28.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:28.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:29.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:29.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:29.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:29.726+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:29.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:29.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:30.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:30.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:30.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:30.734+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:30.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:30.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:31.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:31.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:31.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:31.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:31.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:31.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:32.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:32.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:32.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:32.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:32.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:32.794+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:33.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:33.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:33.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:33.774+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:33.790 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:33.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:34.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:34.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:34.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:34.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:34.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:34.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:35.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:35.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:35.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:35.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:35.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:35.782+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:36.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:36.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:36.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:36.726+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:36.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:36.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:37.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:37.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:37.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:37.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:37.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:37.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:38.586 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:38.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:38.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:38.754+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:38.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:38.798+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:39.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:39.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:39.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:39.766+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:39.826 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:39.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:40.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:40.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:40.743 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:40.738+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:40.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:40.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:41.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:41.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:41.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:41.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:41.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:41.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:42.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:42.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:42.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:42.806+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:42.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:42.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:43.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:43.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:43.825 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:43.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:43.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:43.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:44.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:44.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:44.826 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:44.818+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:44.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:44.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:45.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:45.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:45.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:45.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:45.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:45.846+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:46.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:46.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:46.839 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:46.834+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:46.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:46.838+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:47.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:47.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:47.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:47.826+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:47.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:47.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:48.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:48.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:48.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:48.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:48.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:48.922+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:49.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:49.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:49.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:49.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:49.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:49.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:50.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:50.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:50.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:50.882+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:50.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:50.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:51.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:51.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:51.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:51.874+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:51.918 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:51.910+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:52.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:52.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:52.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:52.842+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:52.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:52.946+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:53.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:53.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:53.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:53.826+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:53.925 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:53.918+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:54.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:54.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:54.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:54.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:54.950 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:54.942+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:55.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:55.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:55.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:55.842+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:55.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:55.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:56.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:56.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:56.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:56.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:56.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:56.954+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:57.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:57.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:57.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:57.898+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:57.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:57.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:58.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:58.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:58.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:58.918+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:10:58.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:10:58.958+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:59.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:10:59.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:10:59.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:10:59.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:00.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:00.006+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:00.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:00.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:00.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:00.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:00.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:00.974+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:01.399 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:01.393+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:01.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:01.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:01.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:01.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:02.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:02.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:02.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:02.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:02.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:02.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:03.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:03.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:03.901 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:03.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:03.971 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:03.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:04.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:04.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:04.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:04.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:04.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:04.941+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:05.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:05.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:05.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:05.897+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:05.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:05.917+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:06.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:06.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:06.898 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:06.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:06.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:06.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:07.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:07.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:07.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:07.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:08.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:08.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:08.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:08.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:08.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:08.849+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:08.992 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:08.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:09.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:09.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:09.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:09.821+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:09.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:09.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:10.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:10.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:10.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:10.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:11.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:11.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:11.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:11.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:11.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:11.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:12.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:11.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:12.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:12.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:12.820 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:12.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:13.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:13.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:13.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:13.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:13.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:13.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:14.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:14.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:14.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:14.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:14.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:14.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:15.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:15.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:15.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:15.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:15.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:15.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:16.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:16.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:16.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:16.633+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:16.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:16.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:17.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:17.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:17.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:17.629+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:17.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:17.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:18.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:18.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:18.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:18.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:18.896 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:18.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:19.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:19.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:19.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:19.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:19.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:19.905+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:20.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:20.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:20.653 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:20.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:20.923 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:20.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:21.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:21.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:21.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:21.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:21.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:21.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:22.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:22.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:22.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:22.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:22.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:22.897+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:23.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:23.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:23.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:23.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:23.912 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:23.909+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:24.056 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:24.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:24.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:24.701+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:24.929 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:24.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:25.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:25.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:25.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:25.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:25.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:25.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:26.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:26.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:26.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:26.685+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:26.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:26.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:27.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:27.133+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:27.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:27.641+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:27.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:27.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:28.140 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:28.137+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:28.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:28.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:28.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:28.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:29.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:29.165+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:29.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:29.641+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:29.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:29.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:30.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:30.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:30.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:30.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:30.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:30.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:31.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:31.185+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:31.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:31.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:31.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:31.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:32.145 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:32.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:32.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:32.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:32.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:32.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:33.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:33.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:33.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:33.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:33.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:33.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:34.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:34.133+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:34.714 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:34.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:35.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:35.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:35.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:35.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:35.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:35.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:35.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:35.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:36.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:36.125+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:36.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:36.693+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:37.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:37.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:37.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:37.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:37.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:37.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:37.990 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:37.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:38.183 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:38.177+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:38.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:38.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:38.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:38.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:39.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:39.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:39.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:39.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:39.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:39.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:40.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:40.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:40.638 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:40.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:41.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:41.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:41.257 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:41.253+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:41.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:41.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:42.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:42.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:42.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:42.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:42.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:42.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:43.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:43.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:43.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:43.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:43.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:43.609+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:44.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:44.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:44.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:44.377+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:44.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:44.601+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:45.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:45.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:45.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:45.337+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:45.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:45.645+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:46.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:46.089+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:46.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:46.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:46.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:46.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:47.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:47.093+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:47.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:47.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:47.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:47.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:48.129 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:48.124+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:48.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:48.344+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:48.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:48.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:49.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:49.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:49.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:49.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:49.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:49.652+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:50.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:50.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:50.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:50.368+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:50.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:50.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:51.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:51.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:51.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:51.340+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:51.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:51.592+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:52.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:52.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:52.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:52.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:52.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:52.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:53.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:53.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:53.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:53.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:53.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:53.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:54.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:54.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:54.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:54.372+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:54.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:54.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:55.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:55.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:55.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:55.392+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:55.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:55.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:56.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:56.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:56.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:56.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:56.646 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:56.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:57.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:57.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:57.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:57.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:57.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:57.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:58.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:58.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:58.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:58.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:58.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:58.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:59.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:11:59.256+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:11:59.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:11:59.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:11:59.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:11:59.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:00.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:00.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:00.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:00.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:00.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:00.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:01.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:01.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:01.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:01.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:01.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:01.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:02.258 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:02.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:02.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:02.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:02.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:02.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:03.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:03.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:03.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:03.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:03.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:03.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:04.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:04.276+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:04.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:04.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:04.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:04.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:05.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:05.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:05.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:05.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:05.591 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:05.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:06.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:06.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:06.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:06.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:06.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:06.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:07.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:07.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:07.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:07.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:07.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:07.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:08.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:08.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:08.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:08.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:08.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:08.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:09.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:09.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:09.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:09.336+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:09.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:09.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:10.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:10.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:10.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:10.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:10.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:10.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:11.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:11.216+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:11.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:11.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:11.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:11.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:12.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:12.236+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:12.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:12.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:12.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:12.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:13.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:13.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:13.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:13.356+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:13.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:13.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:14.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:14.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:14.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:14.312+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:14.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:14.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:15.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:15.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:15.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:15.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:15.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:15.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:16.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:16.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:16.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:16.332+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:16.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:16.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:17.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:17.224+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:17.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:17.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:17.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:17.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:18.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:18.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:18.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:18.276+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:18.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:18.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:19.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:19.228+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:19.233 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:19.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:19.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:19.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:20.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:20.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:20.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:20.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:20.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:20.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:21.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:21.180+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:21.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:21.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:21.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:21.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:22.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:22.148+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:22.269 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:22.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:22.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:22.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:23.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:23.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:23.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:23.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:23.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:23.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:24.212 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:24.208+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:24.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:24.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:24.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:24.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:25.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:25.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:25.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:25.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:25.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:25.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:26.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:26.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:26.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:26.240+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:26.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:26.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:27.255 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:27.252+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:27.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:27.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:27.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:27.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:28.247 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:28.244+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:28.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:28.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:28.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:28.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:29.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:29.196+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:29.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:29.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:29.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:29.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:30.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:30.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:30.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:30.280+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:30.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:30.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:31.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:31.168+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:31.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:31.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:31.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:31.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:32.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:32.160+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:32.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:32.304+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:32.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:32.632+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:33.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:33.192+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:33.289 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:33.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:33.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:33.632+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:34.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:34.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:34.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:34.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:34.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:34.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:35.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:35.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:35.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:35.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:35.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:35.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:36.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:36.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:36.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:36.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:36.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:36.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:37.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:37.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:37.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:37.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:37.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:37.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:38.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:38.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:38.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:38.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:38.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:38.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:39.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:39.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:39.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:39.311+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:39.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:39.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:40.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:40.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:40.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:40.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:40.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:40.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:41.210 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:41.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:41.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:41.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:41.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:41.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:42.256 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:42.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:42.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:42.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:42.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:42.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:43.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:43.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:43.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:43.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:43.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:43.607+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:44.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:44.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:44.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:44.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:44.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:44.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:45.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:45.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:45.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:45.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:45.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:45.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:46.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:46.191+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:46.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:46.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:46.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:46.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:47.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:47.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:47.340 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:47.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:47.600 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:47.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:48.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:48.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:48.345 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:48.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:48.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:48.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:49.193 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:49.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:49.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:49.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:49.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:49.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:50.198 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:50.195+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:50.377 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:50.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:50.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:50.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:51.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:51.167+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:51.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:51.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:51.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:51.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:52.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:52.179+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:52.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:52.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:52.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:52.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:53.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:53.159+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:53.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:53.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:53.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:53.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:54.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:54.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:54.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:54.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:54.633 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:54.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:55.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:55.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:55.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:55.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:55.686 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:55.679+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:56.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:56.151+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:56.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:56.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:56.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:56.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:57.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:57.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:57.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:57.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:57.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:57.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:58.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:58.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:58.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:58.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:58.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:58.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:59.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:12:59.071+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:12:59.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:12:59.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:12:59.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:12:59.667+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:00.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:00.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:00.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:00.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:00.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:00.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:01.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:01.019+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:01.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:01.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:01.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:01.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:01.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:01.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:02.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:02.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:02.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:02.675+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:03.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:02.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:03.447 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:03.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:03.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:03.711+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:04.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:04.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:04.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:04.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:04.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:04.715+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:05.032 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:05.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:05.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:05.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:05.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:05.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:06.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:06.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:06.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:06.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:06.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:06.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:07.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:07.039+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:07.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:07.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:07.836 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:07.831+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:08.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:08.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:08.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:08.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:08.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:08.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:09.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:09.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:09.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:09.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:09.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:09.807+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:10.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:10.063+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:10.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:10.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:10.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:10.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:11.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:11.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:11.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:11.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:11.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:11.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:12.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:12.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:12.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:12.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:12.859 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:12.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:12.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:12.959+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:13.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:13.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:13.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:13.871+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:13.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:13.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:14.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:14.483+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:14.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:14.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:14.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:14.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:15.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:15.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:15.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:15.879+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:15.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:15.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:16.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:16.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:16.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:16.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:16.876 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:16.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:17.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:17.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:17.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:17.847+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:17.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:17.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:18.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:18.455+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:18.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:18.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:18.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:18.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:19.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:19.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:19.836 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:19.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:19.881 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:19.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:20.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:20.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:20.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:20.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:20.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:20.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:21.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:21.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:21.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:21.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:21.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:21.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:22.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:22.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:22.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:22.858+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:22.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:22.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:23.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:23.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:23.894 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:23.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:23.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:23.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:24.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:24.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:24.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:24.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:24.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:24.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:25.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:25.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:25.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:25.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:25.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:25.902+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:26.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:26.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:26.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:26.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:26.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:26.930+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:27.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:27.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:27.855 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:27.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:27.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:27.938+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:28.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:28.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:28.835 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:28.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:28.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:28.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:29.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:29.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:29.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:29.866+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:29.973 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:29.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:30.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:30.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:30.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:30.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:30.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:30.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:31.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:31.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:31.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:31.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:31.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:31.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:32.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:32.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:32.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:32.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:32.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:32.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:33.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:33.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:33.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:33.898+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:33.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:33.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:34.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:34.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:34.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:34.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:34.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:34.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:35.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:35.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:35.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:35.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:35.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:35.922+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:36.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:36.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:36.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:36.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:36.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:36.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:37.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:37.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:37.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:37.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:37.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:37.994+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:38.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:38.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:38.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:38.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:38.994 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:38.990+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:39.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:39.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:39.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:39.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:40.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:40.038+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:40.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:40.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:40.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:40.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:41.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:41.018+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:41.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:41.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:41.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:41.922+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:42.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:42.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:42.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:42.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:42.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:42.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:43.081 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:43.074+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:43.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:43.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:43.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:43.986+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:44.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:44.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:44.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:44.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:45.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:45.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:45.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:45.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:45.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:45.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:45.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:45.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:46.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:46.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:46.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:46.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:46.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:46.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:47.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:47.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:47.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:47.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:47.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:47.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:48.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:48.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:48.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:48.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:49.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:49.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:49.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:49.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:49.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:49.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:50.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:50.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:50.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:50.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:50.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:50.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:51.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:51.078+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:51.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:51.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:51.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:51.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:52.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:52.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:52.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:52.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:52.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:52.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:53.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:53.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:53.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:53.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:53.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:53.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:54.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:54.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:54.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:54.178+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:54.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:54.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:55.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:55.098+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:55.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:55.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:55.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:55.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:56.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:56.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:56.218 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:56.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:56.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:56.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:57.119 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:57.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:57.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:57.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:57.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:57.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:58.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:58.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:58.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:58.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:58.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:58.726+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:59.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:13:59.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:13:59.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:13:59.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:13:59.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:13:59.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:00.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:00.146+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:00.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:00.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:00.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:00.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:01.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:01.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:01.161 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:01.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:01.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:01.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:02.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:02.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:02.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:02.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:02.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:02.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:03.058 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:03.050+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:03.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:03.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:03.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:03.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:04.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:04.070+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:04.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:04.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:04.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:04.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:05.053 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:05.046+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:05.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:05.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:05.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:05.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:06.092 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:06.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:06.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:06.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:06.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:06.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:07.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:07.065+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:07.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:07.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:07.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:07.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:08.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:08.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:08.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:08.097+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:08.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:08.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:09.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:09.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:09.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:09.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:09.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:09.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:10.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:10.081+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:10.113 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:10.105+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:10.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:10.621+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:11.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:11.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:11.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:11.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:11.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:11.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:12.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:12.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:12.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:12.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:12.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:12.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:12.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:12.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:13.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:13.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:13.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:13.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:13.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:13.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:14.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:14.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:14.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:14.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:14.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:14.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:15.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:15.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:15.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:15.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:15.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:15.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:16.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:16.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:16.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:16.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:16.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:16.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:17.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:17.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:17.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:17.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:17.996 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:17.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:18.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:18.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:18.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:18.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:18.958 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:18.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:19.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:19.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:19.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:19.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:19.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:19.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:20.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:20.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:20.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:20.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:20.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:20.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:21.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:21.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:21.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:21.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:21.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:21.905+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:22.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:22.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:22.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:22.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:22.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:22.877+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:23.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:23.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:23.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:23.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:23.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:23.841+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:24.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:24.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:24.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:24.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:24.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:24.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:25.244 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:25.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:25.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:25.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:25.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:25.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:26.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:26.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:26.615 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:26.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:26.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:26.845+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:27.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:27.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:27.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:27.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:27.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:27.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:28.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:28.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:28.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:28.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:28.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:28.893+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:29.270 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:29.265+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:29.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:29.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:29.886 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:29.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:30.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:30.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:30.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:30.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:30.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:30.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:31.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:31.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:31.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:31.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:31.935 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:31.933+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:32.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:32.285+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:32.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:32.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:32.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:32.921+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:33.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:33.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:33.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:33.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:33.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:33.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:34.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:34.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:34.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:34.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:34.998 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:34.993+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:35.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:35.285+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:35.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:35.633+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:36.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:36.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:36.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:36.285+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:36.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:36.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:37.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:37.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:37.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:37.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:37.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:37.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:38.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:38.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:38.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:38.265+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:38.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:38.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:39.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:39.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:39.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:39.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:39.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:39.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:39.956 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:39.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:40.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:40.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:40.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:40.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:40.959 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:40.957+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:41.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:41.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:41.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:41.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:41.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:41.937+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:42.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:42.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:42.558 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:42.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:42.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:42.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:43.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:43.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:43.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:43.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:43.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:43.981+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:44.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:44.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:44.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:44.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:45.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:45.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:45.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:45.285+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:45.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:45.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:46.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:46.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:46.285 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:46.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:46.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:46.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:47.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:47.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:47.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:47.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:47.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:47.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:48.034 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:48.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:48.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:48.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:48.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:48.617+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:49.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:49.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:49.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:49.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:49.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:49.621+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:50.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:50.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:50.315 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:50.313+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:50.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:50.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:51.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:51.045+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:51.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:51.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:51.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:51.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:52.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:52.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:52.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:52.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:52.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:52.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:52.962 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:52.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:53.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:53.244+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:53.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:53.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:53.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:53.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:54.279 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:54.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:54.659 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:54.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:54.944 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:54.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:55.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:55.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:55.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:55.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:55.976 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:55.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:56.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:56.284+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:56.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:56.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:56.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:56.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:57.261 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:57.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:57.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:57.648+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:57.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:57.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:58.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:58.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:58.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:58.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:58.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:58.924+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:14:59.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:14:59.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:59.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:14:59.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:14:59.917 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:14:59.912+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:00.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:00.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:00.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:00.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:00.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:00.956+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:01.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:01.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:01.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:01.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:01.979 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:01.976+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:02.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:02.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:02.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:02.740+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:03.013 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:03.008+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:03.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:03.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:03.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:03.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:03.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:03.988+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:04.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:04.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:04.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:04.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:05.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:05.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:05.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:05.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:05.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:05.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:06.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:06.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:06.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:06.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:06.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:06.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:06.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:06.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:07.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:07.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:07.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:07.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:07.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:07.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:08.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:08.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:08.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:08.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:09.003 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:09.000+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:09.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:09.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:09.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:09.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:10.001 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:09.996+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:10.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:10.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:10.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:10.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:11.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:11.040+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:11.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:11.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:11.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:11.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:12.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:12.004+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:12.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:12.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:12.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:12.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:12.984 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:12.980+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:13.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:13.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:13.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:13.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:14.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:14.016+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:14.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:14.148+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:14.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:14.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:15.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:15.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:15.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:15.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:15.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:15.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:16.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:16.016+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:16.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:16.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:16.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:16.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:17.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:17.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:17.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:17.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:17.642 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:17.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:18.025 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:18.020+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:18.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:18.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:18.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:18.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:19.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:19.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:19.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:19.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:19.573 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:19.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:20.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:20.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:20.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:20.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:20.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:20.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:21.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:21.100+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:21.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:21.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:21.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:21.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:22.133 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:22.128+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:22.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:22.244+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:22.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:22.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:23.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:23.104+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:23.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:23.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:23.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:23.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:24.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:24.156+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:24.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:24.272+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:24.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:24.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:25.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:25.112+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:25.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:25.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:25.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:25.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:26.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:26.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:26.254 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:26.248+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:26.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:26.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:27.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:27.168+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:27.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:27.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:27.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:27.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:28.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:28.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:28.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:28.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:28.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:28.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:29.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:29.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:29.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:29.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:29.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:29.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:30.139 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:30.136+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:30.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:30.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:30.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:30.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:31.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:31.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:31.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:31.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:31.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:31.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:32.156 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:32.152+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:32.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:32.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:32.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:32.616+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:33.168 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:33.164+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:33.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:33.268+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:33.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:33.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:34.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:34.204+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:34.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:34.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:34.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:34.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:35.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:35.168+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:35.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:35.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:35.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:35.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:36.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:36.140+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:36.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:36.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:36.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:36.732+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:37.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:37.172+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:37.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:37.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:37.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:37.684+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:38.217 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:38.212+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:38.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:38.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:38.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:38.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:39.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:39.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:39.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:39.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:39.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:39.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:40.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:40.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:40.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:40.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:40.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:40.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:41.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:41.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:41.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:41.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:41.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:41.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:42.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:42.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:42.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:42.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:42.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:42.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:43.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:43.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:43.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:43.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:43.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:43.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:44.245 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:44.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:44.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:44.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:44.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:44.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:45.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:45.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:45.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:45.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:45.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:45.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:46.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:46.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:46.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:46.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:46.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:46.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:47.228 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:47.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:47.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:47.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:47.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:47.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:48.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:48.251+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:48.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:48.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:48.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:48.619+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:49.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:49.211+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:49.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:49.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:49.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:49.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:50.209 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:50.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:50.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:50.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:50.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:50.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:51.248 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:51.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:51.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:51.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:51.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:51.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:52.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:52.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:52.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:52.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:52.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:52.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:53.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:53.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:53.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:53.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:53.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:53.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:54.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:54.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:54.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:54.563+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:54.611 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:54.607+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:55.237 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:55.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:55.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:55.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:55.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:55.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:56.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:56.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:56.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:56.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:56.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:56.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:57.199 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:57.195+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:57.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:57.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:57.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:57.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:58.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:58.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:58.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:58.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:58.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:58.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:59.228 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:15:59.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:15:59.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:15:59.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:15:59.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:15:59.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:00.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:00.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:00.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:00.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:00.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:00.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:01.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:01.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:01.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:01.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:01.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:01.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:02.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:02.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:02.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:02.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:02.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:02.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:03.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:03.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:03.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:03.639+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:03.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:03.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:04.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:04.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:04.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:04.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:04.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:04.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:05.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:05.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:05.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:05.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:05.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:05.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:06.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:06.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:06.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:06.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:06.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:06.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:07.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:07.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:07.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:07.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:07.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:07.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:08.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:08.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:08.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:08.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:08.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:08.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:09.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:09.247+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:09.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:09.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:09.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:09.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:10.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:10.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:10.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:10.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:10.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:10.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:11.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:11.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:11.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:11.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:11.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:11.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:12.308 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:12.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:12.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:12.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:12.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:12.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:13.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:13.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:13.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:13.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:13.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:13.603+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:14.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:14.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:14.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:14.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:14.622 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:14.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:15.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:15.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:15.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:15.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:15.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:15.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:16.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:16.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:16.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:16.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:16.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:16.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:17.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:17.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:17.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:17.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:17.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:17.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:18.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:18.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:18.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:18.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:18.655 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:18.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:19.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:19.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:19.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:19.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:19.731 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:19.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:20.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:20.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:20.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:20.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:20.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:20.707+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:21.295 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:21.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:21.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:21.663+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:21.699 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:21.695+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:22.315 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:22.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:22.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:22.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:22.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:22.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:23.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:23.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:23.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:23.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:23.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:23.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:24.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:24.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:24.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:24.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:24.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:24.763+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:25.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:25.370+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:25.639 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:25.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:25.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:25.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:26.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:26.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:26.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:26.606+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:26.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:26.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:27.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:27.370+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:27.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:27.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:27.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:27.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:28.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:28.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:28.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:28.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:28.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:28.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:29.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:29.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:29.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:29.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:29.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:29.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:30.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:30.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:30.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:30.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:30.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:30.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:31.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:31.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:31.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:31.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:31.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:31.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:32.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:32.278+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:32.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:32.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:32.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:32.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:33.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:33.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:33.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:33.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:33.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:33.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:34.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:34.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:34.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:34.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:34.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:34.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:35.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:35.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:35.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:35.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:35.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:35.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:36.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:36.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:36.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:36.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:36.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:36.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:37.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:37.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:37.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:37.606+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:37.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:37.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:38.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:38.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:38.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:38.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:38.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:38.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:39.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:39.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:39.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:39.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:39.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:39.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:40.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:40.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:40.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:40.570+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:40.625 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:40.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:41.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:41.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:41.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:41.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:41.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:41.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:42.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:42.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:42.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:42.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:42.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:42.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:43.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:43.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:43.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:43.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:43.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:43.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:44.232 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:44.226+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:44.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:44.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:44.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:44.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:45.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:45.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:45.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:45.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:45.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:45.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:46.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:46.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:46.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:46.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:46.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:46.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:47.259 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:47.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:47.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:47.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:47.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:47.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:48.230 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:48.222+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:48.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:48.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:48.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:48.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:49.252 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:49.246+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:49.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:49.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:49.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:49.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:50.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:50.286+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:50.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:50.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:50.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:50.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:51.276 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:51.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:51.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:51.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:51.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:51.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:52.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:52.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:52.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:52.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:52.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:52.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:53.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:53.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:53.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:53.506+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:53.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:53.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:54.266 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:54.262+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:54.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:54.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:54.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:54.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:55.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:55.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:55.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:55.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:55.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:55.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:56.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:56.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:56.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:56.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:56.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:56.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:57.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:57.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:57.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:57.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:57.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:57.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:58.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:58.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:58.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:58.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:58.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:58.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:59.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:16:59.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:16:59.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:16:59.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:16:59.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:16:59.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:00.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:00.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:00.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:00.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:00.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:00.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:01.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:01.362+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:01.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:01.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:01.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:01.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:02.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:02.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:02.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:02.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:02.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:02.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:03.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:03.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:03.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:03.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:03.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:03.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:04.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:04.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:04.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:04.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:04.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:04.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:05.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:05.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:05.445 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:05.438+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:05.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:05.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:06.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:06.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:06.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:06.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:06.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:06.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:07.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:07.330+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:07.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:07.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:07.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:07.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:08.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:08.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:08.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:08.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:08.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:08.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:09.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:09.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:09.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:09.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:09.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:09.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:10.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:10.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:10.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:10.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:10.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:10.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:11.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:11.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:11.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:11.481+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:11.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:11.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:12.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:12.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:12.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:12.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:12.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:12.621+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:13.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:13.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:13.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:13.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:13.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:13.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:14.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:14.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:14.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:14.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:14.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:14.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:15.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:15.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:15.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:15.429+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:15.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:15.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:16.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:16.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:16.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:16.429+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:16.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:16.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:17.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:17.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:17.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:17.381+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:17.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:17.793+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:18.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:18.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:18.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:18.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:18.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:18.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:19.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:19.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:19.452 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:19.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:19.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:19.857+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:20.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:20.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:20.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:20.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:20.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:20.901+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:21.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:21.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:21.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:21.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:21.883 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:21.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:22.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:22.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:22.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:22.453+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:22.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:22.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:23.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:23.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:23.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:23.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:23.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:23.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:24.279 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:24.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:24.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:24.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:24.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:24.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:25.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:25.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:25.452 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:25.449+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:25.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:25.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:26.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:26.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:26.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:26.481+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:26.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:26.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:27.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:27.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:27.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:27.481+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:27.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:27.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:28.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:28.257+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:28.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:28.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:28.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:28.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:29.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:29.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:29.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:29.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:29.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:29.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:30.272 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:30.269+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:30.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:30.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:30.759 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:30.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:31.305 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:31.301+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:31.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:31.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:31.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:31.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:32.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:32.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:32.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:32.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:32.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:32.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:33.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:33.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:33.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:33.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:33.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:33.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:34.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:34.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:34.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:34.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:34.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:34.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:35.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:35.313+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:35.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:35.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:35.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:35.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:36.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:36.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:36.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:36.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:36.770 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:36.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:37.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:37.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:37.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:37.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:37.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:37.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:38.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:38.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:38.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:38.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:38.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:38.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:39.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:39.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:39.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:39.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:39.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:39.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:40.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:40.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:40.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:40.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:40.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:40.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:41.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:41.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:41.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:41.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:41.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:41.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:42.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:42.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:42.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:42.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:42.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:42.693+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:43.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:43.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:43.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:43.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:43.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:43.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:44.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:44.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:44.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:44.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:44.722 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:44.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:45.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:45.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:45.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:45.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:45.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:45.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:46.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:46.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:46.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:46.557+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:46.739 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:46.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:47.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:47.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:47.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:47.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:47.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:47.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:48.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:48.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:48.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:48.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:48.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:48.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:49.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:49.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:49.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:49.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:49.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:49.833+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:50.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:50.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:50.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:50.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:50.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:50.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:51.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:51.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:51.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:51.509+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:51.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:51.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:52.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:52.409+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:52.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:52.493+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:52.825 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:52.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:53.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:53.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:53.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:53.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:53.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:53.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:54.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:54.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:54.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:54.557+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:54.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:54.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:55.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:55.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:55.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:55.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:55.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:55.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:56.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:56.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:56.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:56.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:56.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:56.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:57.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:57.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:57.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:57.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:57.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:57.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:58.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:58.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:58.593 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:58.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:58.776 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:58.772+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:59.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:17:59.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:17:59.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:17:59.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:17:59.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:17:59.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:00.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:00.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:00.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:00.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:00.863 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:00.860+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:01.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:01.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:01.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:01.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:01.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:01.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:02.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:02.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:02.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:02.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:02.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:02.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:03.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:03.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:03.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:03.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:03.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:03.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:04.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:04.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:04.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:04.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:04.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:04.964+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:05.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:05.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:05.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:05.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:06.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:06.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:06.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:06.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:06.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:06.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:06.980 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:06.976+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:07.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:07.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:07.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:07.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:08.014 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:08.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:08.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:08.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:08.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:08.648+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:09.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:09.032+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:09.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:09.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:09.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:09.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:10.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:10.020+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:10.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:10.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:10.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:10.700+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:11.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:11.036+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:11.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:11.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:11.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:11.684+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:12.027 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:12.024+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:12.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:12.344+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:12.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:12.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:13.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:13.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:13.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:13.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:13.669 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:13.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:14.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:14.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:14.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:14.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:14.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:14.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:15.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:15.124+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:15.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:15.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:15.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:15.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:16.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:16.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:16.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:16.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:16.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:16.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:17.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:17.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:17.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:17.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:17.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:17.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:18.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:18.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:18.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:18.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:18.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:18.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:19.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:19.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:19.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:19.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:19.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:19.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:20.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:20.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:20.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:20.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:20.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:20.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:21.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:21.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:21.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:21.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:21.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:21.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:22.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:22.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:22.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:22.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:22.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:22.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:23.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:23.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:23.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:23.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:23.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:23.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:24.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:24.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:24.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:24.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:24.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:24.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:25.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:25.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:25.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:25.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:25.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:25.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:26.100 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:26.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:26.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:26.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:26.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:26.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:27.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:27.144+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:27.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:27.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:27.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:27.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:28.181 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:28.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:28.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:28.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:28.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:28.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:29.175 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:29.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:29.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:29.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:29.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:29.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:30.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:30.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:30.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:30.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:30.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:30.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:31.128 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:31.124+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:31.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:31.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:31.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:31.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:32.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:32.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:32.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:32.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:32.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:32.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:33.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:33.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:33.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:33.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:33.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:33.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:34.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:34.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:34.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:34.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:34.557 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:34.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:35.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:35.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:35.498 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:35.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:35.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:35.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:36.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:36.168+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:36.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:36.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:36.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:36.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:37.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:37.204+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:37.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:37.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:37.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:37.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:38.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:38.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:38.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:38.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:38.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:38.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:39.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:39.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:39.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:39.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:39.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:39.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:40.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:40.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:40.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:40.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:40.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:40.536+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:41.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:41.256+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:41.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:41.548+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:41.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:41.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:42.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:42.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:42.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:42.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:42.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:42.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:43.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:43.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:43.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:43.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:43.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:43.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:44.306 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:44.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:44.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:44.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:44.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:44.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:45.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:45.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:45.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:45.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:45.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:45.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:46.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:46.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:46.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:46.423+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:46.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:46.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:47.329 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:47.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:47.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:47.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:47.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:47.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:48.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:48.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:48.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:48.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:48.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:48.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:49.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:49.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:49.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:49.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:49.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:49.659+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:50.296 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:50.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:50.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:50.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:50.691 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:50.687+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:51.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:51.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:51.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:51.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:51.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:51.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:52.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:52.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:52.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:52.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:52.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:52.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:53.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:53.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:53.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:53.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:53.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:53.707+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:54.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:54.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:54.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:54.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:54.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:54.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:55.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:55.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:55.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:55.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:55.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:55.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:56.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:56.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:56.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:56.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:56.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:56.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:57.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:57.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:57.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:57.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:57.749 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:57.743+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:58.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:58.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:58.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:58.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:58.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:58.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:59.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:18:59.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:18:59.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:18:59.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:18:59.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:18:59.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:00.376 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:00.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:00.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:00.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:00.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:00.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:01.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:01.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:01.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:01.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:01.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:01.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:02.360 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:02.355+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:02.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:02.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:02.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:02.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:03.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:03.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:03.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:03.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:03.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:03.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:04.375 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:04.371+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:04.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:04.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:04.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:04.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:05.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:05.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:05.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:05.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:05.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:05.775+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:06.337 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:06.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:06.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:06.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:06.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:06.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:07.300 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:07.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:07.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:07.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:07.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:07.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:08.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:08.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:08.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:08.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:08.876 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:08.871+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:09.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:09.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:09.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:09.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:09.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:09.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:10.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:10.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:10.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:10.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:10.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:10.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:11.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:11.263+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:11.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:11.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:11.900 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:11.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:12.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:12.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:12.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:12.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:12.887 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:12.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:13.266 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:13.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:13.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:13.583+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:13.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:13.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:14.260 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:14.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:14.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:14.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:14.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:14.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:15.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:15.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:15.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:15.583+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:15.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:15.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:16.293 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:16.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:16.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:16.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:16.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:16.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:17.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:17.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:17.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:17.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:17.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:17.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:18.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:18.263+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:18.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:18.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:18.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:18.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:19.303 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:19.299+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:19.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:19.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:19.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:19.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:20.341 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:20.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:20.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:20.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:20.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:20.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:21.387 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:21.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:21.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:21.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:21.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:21.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:22.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:22.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:22.591 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:22.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:22.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:22.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:23.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:23.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:23.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:23.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:24.020 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:24.015+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:24.351 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:24.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:24.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:24.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:25.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:25.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:25.372 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:25.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:25.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:25.595+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:26.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:26.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:26.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:26.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:26.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:26.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:27.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:27.071+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:27.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:27.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:27.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:27.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:28.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:28.075+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:28.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:28.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:28.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:28.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:29.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:29.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:29.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:29.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:29.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:29.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:30.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:30.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:30.384 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:30.378+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:30.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:30.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:31.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:31.058+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:31.371 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:31.366+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:31.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:31.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:32.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:32.094+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:32.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:32.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:32.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:32.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:33.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:33.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:33.357 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:33.350+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:33.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:33.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:34.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:34.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:34.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:34.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:34.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:34.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:35.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:35.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:35.413 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:35.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:35.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:35.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:36.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:36.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:36.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:36.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:36.636 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:36.630+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:37.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:37.150+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:37.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:37.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:37.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:37.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:38.143 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:38.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:38.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:38.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:38.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:38.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:39.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:39.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:39.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:39.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:39.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:39.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:40.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:40.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:40.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:40.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:40.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:40.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:41.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:41.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:41.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:41.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:41.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:41.650+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:42.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:42.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:42.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:42.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:42.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:42.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:43.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:43.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:43.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:43.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:43.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:43.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:44.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:44.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:44.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:44.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:44.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:44.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:45.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:45.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:45.469 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:45.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:45.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:45.730+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:46.169 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:46.162+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:46.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:46.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:46.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:46.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:47.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:47.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:47.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:47.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:47.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:47.694+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:48.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:48.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:48.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:48.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:48.669 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:48.662+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:49.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:49.154+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:49.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:49.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:49.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:49.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:50.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:50.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:50.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:50.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:50.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:50.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:51.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:51.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:51.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:51.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:51.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:51.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:52.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:52.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:52.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:52.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:52.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:52.610+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:53.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:53.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:53.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:53.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:53.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:53.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:54.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:54.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:54.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:54.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:54.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:54.566+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:55.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:55.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:55.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:55.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:55.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:55.550+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:56.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:56.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:56.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:56.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:56.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:56.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:57.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:57.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:57.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:57.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:57.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:57.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:58.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:58.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:58.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:58.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:58.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:58.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:19:59.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:19:59.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:59.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:19:59.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:19:59.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:19:59.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:00.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:00.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:00.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:00.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:00.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:00.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:01.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:01.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:01.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:01.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:01.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:01.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:02.336 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:02.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:02.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:02.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:02.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:02.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:03.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:03.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:03.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:03.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:03.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:03.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:04.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:04.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:04.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:04.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:04.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:04.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:05.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:05.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:05.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:05.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:05.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:05.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:06.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:06.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:06.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:06.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:06.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:06.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:07.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:07.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:07.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:07.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:07.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:07.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:08.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:08.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:08.527 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:08.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:08.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:08.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:09.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:09.278+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:09.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:09.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:09.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:09.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:10.250 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:10.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:10.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:10.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:10.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:10.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:11.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:11.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:11.503 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:11.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:11.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:11.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:12.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:12.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:12.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:12.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:12.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:12.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:13.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:13.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:13.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:13.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:13.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:13.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:14.226 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:14.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:14.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:14.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:14.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:14.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:15.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:15.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:15.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:15.562+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:15.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:15.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:16.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:16.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:16.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:16.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:16.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:16.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:17.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:17.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:17.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:17.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:17.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:17.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:18.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:18.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:18.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:18.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:18.570 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:18.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:19.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:19.061+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:19.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:19.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:19.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:19.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:20.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:20.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:20.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:20.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:20.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:20.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:21.098 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:21.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:21.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:21.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:21.653 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:21.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:22.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:22.057+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:22.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:22.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:22.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:22.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:23.062 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:23.053+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:23.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:23.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:23.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:23.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:24.051 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:24.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:24.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:24.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:24.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:24.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:25.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:25.081+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:25.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:25.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:25.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:25.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:26.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:26.073+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:26.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:26.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:26.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:26.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:27.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:27.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:27.642 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:27.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:27.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:27.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:28.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:28.137+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:28.639 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:28.637+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:28.767 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:28.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:29.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:29.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:29.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:29.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:29.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:29.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:30.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:30.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:30.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:30.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:30.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:30.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:31.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:31.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:31.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:31.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:31.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:31.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:32.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:32.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:32.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:32.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:32.841 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:32.837+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:33.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:33.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:33.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:33.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:33.891 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:33.889+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:34.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:34.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:34.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:34.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:34.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:34.885+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:35.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:35.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:35.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:35.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:35.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:35.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:36.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:36.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:36.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:36.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:36.913 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:36.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:37.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:37.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:37.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:37.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:37.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:37.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:38.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:38.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:38.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:38.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:38.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:38.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:39.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:39.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:39.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:39.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:39.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:39.921+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:40.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:40.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:40.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:40.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:40.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:40.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:41.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:41.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:41.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:41.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:41.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:41.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:42.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:42.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:42.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:42.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:42.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:42.865+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:43.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:43.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:43.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:43.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:43.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:43.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:44.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:44.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:44.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:44.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:44.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:44.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:45.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:45.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:45.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:45.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:45.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:45.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:46.409 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:46.405+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:46.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:46.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:46.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:46.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:47.379 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:47.377+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:47.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:47.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:47.964 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:47.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:48.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:48.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:48.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:48.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:48.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:48.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:49.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:49.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:49.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:49.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:49.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:49.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:50.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:50.277+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:50.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:50.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:50.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:50.941+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:51.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:51.329+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:51.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:51.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:51.936 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:51.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:52.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:52.317+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:52.629 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:52.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:52.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:52.981+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:53.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:53.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:53.663 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:53.661+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:53.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:53.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:54.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:54.349+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:54.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:54.677+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:54.995 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:54.993+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:55.346 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:55.341+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:55.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:55.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:55.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:55.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:56.383 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:56.381+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:56.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:56.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:56.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:56.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:57.424 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:57.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:57.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:57.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:58.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:57.997+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:58.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:58.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:58.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:58.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:20:58.955 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:20:58.953+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:59.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:20:59.429+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:20:59.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:20:59.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:00.006 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:00.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:00.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:00.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:00.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:00.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:00.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:00.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:01.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:01.457+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:01.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:01.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:01.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:01.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:02.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:02.429+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:02.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:02.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:02.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:02.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:03.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:03.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:03.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:03.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:03.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:03.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:04.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:04.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:04.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:04.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:04.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:04.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:05.355 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:05.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:05.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:05.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:05.961 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:05.956+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:06.374 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:06.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:06.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:06.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:07.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:07.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:07.349 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:07.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:07.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:07.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:08.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:08.048+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:08.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:08.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:08.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:08.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:09.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:09.028+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:09.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:09.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:09.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:09.648+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:10.061 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:10.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:10.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:10.392+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:10.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:10.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:11.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:11.032+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:11.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:11.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:11.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:11.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:12.013 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:12.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:12.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:12.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:12.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:12.560+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:13.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:13.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:13.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:13.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:13.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:13.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:14.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:14.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:14.361 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:14.356+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:14.547 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:14.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:15.087 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:15.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:15.375 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:15.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:15.593 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:15.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:16.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:16.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:16.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:16.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:16.578 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:16.572+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:17.112 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:17.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:17.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:17.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:17.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:17.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:18.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:18.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:18.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:18.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:18.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:18.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:19.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:19.124+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:19.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:19.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:19.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:19.652+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:20.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:20.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:20.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:20.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:20.672 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:20.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:21.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:21.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:21.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:21.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:21.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:21.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:22.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:22.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:22.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:22.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:22.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:22.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:23.097 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:23.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:23.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:23.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:23.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:23.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:24.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:24.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:24.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:24.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:24.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:24.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:25.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:25.092+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:25.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:25.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:25.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:25.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:26.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:26.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:26.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:26.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:26.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:26.692+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:27.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:27.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:27.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:27.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:27.745 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:27.740+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:28.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:28.048+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:28.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:28.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:28.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:28.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:29.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:29.008+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:29.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:29.512+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:29.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:29.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:29.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:29.972+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:30.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:30.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:30.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:30.708+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:30.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:30.944+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:31.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:31.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:31.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:31.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:31.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:31.940+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:32.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:32.460+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:32.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:32.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:32.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:32.916+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:33.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:33.480+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:33.699 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:33.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:33.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:33.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:34.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:34.480+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:34.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:34.720+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:34.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:34.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:35.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:35.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:35.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:35.692+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:35.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:35.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:36.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:36.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:36.698 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:36.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:36.986 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:36.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:37.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:37.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:37.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:37.728+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:38.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:38.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:38.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:38.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:38.732 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:38.728+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:38.972 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:38.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:39.485 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:39.480+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:39.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:39.720+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:39.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:39.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:40.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:40.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:40.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:40.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:40.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:40.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:41.458 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:41.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:41.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:41.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:41.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:41.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:42.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:42.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:42.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:42.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:42.994 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:42.992+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:43.411 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:43.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:43.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:43.648+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:43.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:43.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:44.455 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:44.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:44.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:44.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:44.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:44.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:45.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:45.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:45.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:45.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:45.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:45.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:46.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:46.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:46.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:46.656+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:46.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:46.932+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:47.429 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:47.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:47.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:47.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:47.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:47.884+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:48.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:48.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:48.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:48.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:48.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:48.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:49.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:49.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:49.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:49.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:49.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:49.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:50.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:50.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:50.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:50.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:50.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:50.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:51.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:51.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:51.719 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:51.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:51.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:51.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:52.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:52.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:52.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:52.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:52.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:52.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:53.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:53.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:53.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:53.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:53.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:53.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:54.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:54.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:54.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:54.763+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:54.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:54.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:55.635 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:55.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:55.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:55.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:55.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:55.839+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:56.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:56.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:56.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:56.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:56.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:56.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:57.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:57.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:57.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:57.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:57.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:57.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:58.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:58.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:58.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:58.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:58.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:58.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:59.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:21:59.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:21:59.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:21:59.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:21:59.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:21:59.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:00.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:00.643+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:00.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:00.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:00.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:00.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:01.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:01.607+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:01.737 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:01.731+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:01.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:01.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:02.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:02.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:02.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:02.759+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:02.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:02.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:03.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:03.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:03.798 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:03.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:03.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:03.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:04.599 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:04.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:04.753 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:04.747+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:04.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:04.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:05.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:05.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:05.789 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:05.783+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:05.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:05.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:06.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:06.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:06.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:06.751+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:06.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:06.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:07.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:07.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:07.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:07.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:07.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:07.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:08.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:08.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:08.762 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:08.759+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:08.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:08.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:09.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:09.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:09.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:09.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:09.909 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:09.903+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:10.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:10.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:10.799 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:10.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:10.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:10.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:11.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:11.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:11.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:11.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:11.893 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:11.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:12.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:12.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:12.811 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:12.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:12.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:12.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:13.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:13.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:13.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:13.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:13.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:13.859+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:14.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:14.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:14.800 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:14.795+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:14.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:14.907+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:15.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:15.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:15.850 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:15.843+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:15.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:15.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:16.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:16.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:16.837 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:16.831+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:16.946 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:16.939+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:17.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:17.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:17.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:17.855+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:17.917 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:17.911+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:18.575 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:18.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:18.878 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:18.871+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:18.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:18.895+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:19.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:19.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:19.908 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:19.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:19.947 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:19.943+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:20.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:20.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:20.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:20.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:20.990 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:20.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:21.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:21.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:21.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:21.955+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:21.965 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:21.959+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:22.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:22.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:22.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:22.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:22.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:22.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:23.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:23.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:23.903 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:23.899+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:23.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:23.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:24.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:24.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:24.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:24.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:24.941 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:24.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:25.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:25.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:25.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:25.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:25.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:25.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:26.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:26.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:26.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:26.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:26.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:26.983+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:27.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:27.591+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:27.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:27.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:28.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:27.999+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:28.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:28.635+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:28.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:28.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:29.007 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:29.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:29.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:29.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:29.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:29.887+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:30.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:30.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:30.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:30.595+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:30.889 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:30.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:31.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:31.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:31.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:31.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:31.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:31.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:32.040 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:32.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:32.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:32.599+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:32.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:32.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:33.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:33.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:33.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:33.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:33.881 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:33.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:34.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:34.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:34.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:34.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:34.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:34.879+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:35.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:35.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:35.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:35.650+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:35.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:35.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:35.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:35.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:36.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:36.670+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:36.913 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:36.906+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:37.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:36.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:37.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:37.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:37.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:37.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:37.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:37.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:38.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:38.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:38.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:38.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:38.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:38.970+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:39.710 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:39.702+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:39.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:39.798+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:40.004 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:39.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:40.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:40.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:40.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:40.842+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:40.960 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:40.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:41.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:41.654+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:41.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:41.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:41.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:41.970+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:42.612 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:42.606+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:42.888 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:42.882+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:42.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:42.934+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:43.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:43.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:43.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:43.894+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:43.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:43.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:44.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:44.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:44.880 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:44.874+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:44.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:44.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:45.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:45.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:45.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:45.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:45.951 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:45.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:46.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:46.570+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:46.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:46.866+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:46.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:46.966+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:47.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:47.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:47.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:47.854+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:48.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:48.010+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:48.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:48.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:48.907 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:48.902+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:49.046 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:49.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:49.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:49.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:49.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:49.898+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:50.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:50.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:50.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:50.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:50.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:50.858+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:51.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:51.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:51.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:51.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:51.824 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:51.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:51.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:51.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:52.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:52.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:52.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:52.822+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:52.992 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:52.986+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:53.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:53.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:53.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:53.810+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:53.995 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:53.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:54.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:54.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:54.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:54.814+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:54.983 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:54.978+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:55.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:55.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:55.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:55.862+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:55.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:55.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:56.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:56.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:56.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:56.890+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:56.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:56.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:57.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:57.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:57.928 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:57.922+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:57.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:57.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:58.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:58.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:58.914 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:58.910+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:58.931 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:58.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:59.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:22:59.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:22:59.913 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:22:59.906+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:22:59.942 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:22:59.934+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:00.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:00.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:00.904 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:00.898+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:00.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:00.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:01.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:01.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:01.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:01.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:01.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:01.954+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:02.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:02.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:02.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:02.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:02.986 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:02.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:03.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:03.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:03.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:03.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:04.018 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:04.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:04.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:04.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:04.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:04.926+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:04.991 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:04.986+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:05.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:05.558+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:05.915 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:05.910+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:06.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:06.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:06.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:06.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:06.944 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:06.938+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:07.002 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:06.994+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:07.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:07.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:07.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:07.962+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:08.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:08.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:08.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:08.622+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:08.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:08.958+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:09.061 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:09.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:09.602 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:09.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:09.920 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:09.914+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:10.086 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:10.078+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:10.574 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:10.566+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:10.876 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:10.870+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:11.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:11.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:11.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:11.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:11.857 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:11.850+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:12.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:12.078+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:12.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:12.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:12.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:12.830+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:13.043 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:13.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:13.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:13.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:13.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:13.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:14.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:14.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:14.621 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:14.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:14.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:14.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:15.045 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:15.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:15.619 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:15.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:15.765 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:15.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:16.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:16.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:16.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:16.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:16.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:16.734+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:17.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:17.058+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:17.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:17.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:17.783 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:17.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:18.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:18.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:18.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:18.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:18.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:18.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:18.981 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:18.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:19.644 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:19.638+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:19.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:19.846+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:19.989 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:19.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:20.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:20.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:20.840 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:20.834+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:20.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:20.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:21.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:21.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:21.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:21.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:21.972 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:21.965+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:22.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:22.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:22.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:22.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:22.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:22.949+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:23.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:23.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:23.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:23.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:23.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:23.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:24.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:24.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:24.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:24.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:24.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:24.989+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:25.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:25.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:25.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:25.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:25.994 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:25.985+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:26.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:26.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:26.803 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:26.797+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:27.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:27.001+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:27.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:27.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:27.818 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:27.809+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:27.978 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:27.969+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:28.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:28.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:28.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:28.861+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:28.961 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:28.953+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:29.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:29.681+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:29.885 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:29.877+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:29.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:29.909+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:30.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:30.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:30.861 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:30.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:30.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:30.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:31.745 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:31.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:31.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:31.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:31.968 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:31.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:32.777 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:32.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:32.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:32.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:33.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:33.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:33.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:33.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:33.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:33.829+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:33.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:33.973+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:34.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:34.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:34.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:34.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:35.009 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:35.005+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:35.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:35.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:35.782 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:35.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:35.964 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:35.961+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:36.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:36.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:36.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:36.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:36.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:36.929+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:37.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:37.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:37.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:37.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:37.921 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:37.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:38.726 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:38.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:38.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:38.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:38.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:38.941+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:39.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:39.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:39.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:39.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:39.928 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:39.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:40.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:40.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:40.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:40.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:40.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:40.921+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:41.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:41.681+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:41.719 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:41.717+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:41.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:41.885+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:42.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:42.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:42.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:42.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:42.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:42.933+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:43.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:43.681+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:43.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:43.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:43.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:43.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:44.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:44.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:44.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:44.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:44.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:44.897+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:45.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:45.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:45.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:45.825+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:45.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:45.857+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:46.466 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T19:23:46.461+0000 7fbc9ff2a700 0 -- 172.21.15.196:0/2198265222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbc8002da20 msgr2=0x7fbc800361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T19:23:46.466 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T19:23:46.461+0000 7fbc9ff2a700 0 -- 172.21.15.196:0/2198265222 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x55c57a99b570 msgr2=0x7fbc80042650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-11-08T19:23:46.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:46.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:46.830 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:46.829+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:46.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:46.849+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:47.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:47.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:47.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:47.833+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:47.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:47.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:48.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:48.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:48.821 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:48.817+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:48.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:48.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:49.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:49.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:49.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:49.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:49.868 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:49.865+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:50.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:50.629+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:50.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:50.837+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:50.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:50.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:51.595 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:51.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:51.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:51.881+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:51.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:51.913+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:52.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:52.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:52.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:52.845+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:52.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:52.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:53.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:53.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:53.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:53.805+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:53.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:53.857+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:54.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:54.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:54.812 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:54.809+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:54.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:54.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:55.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:55.589+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:55.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:55.809+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:55.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:55.821+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:56.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:56.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:56.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:56.833+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:56.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:56.865+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:57.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:57.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:57.872 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:57.869+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:57.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:57.913+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:58.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:58.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:58.899 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:58.897+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:23:58.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:58.905+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:59.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:23:59.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:59.896 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:23:59.893+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:23:59.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:23:59.917+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:00.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:00.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:00.903 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:00.901+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:00.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:00.925+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:01.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:01.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:01.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:01.877+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:01.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:01.909+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:02.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:02.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:02.841 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:02.837+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:02.963 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:02.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:03.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:03.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:03.875 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:03.873+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:03.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:03.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:04.546 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:04.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:04.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:04.901+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:05.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:05.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:05.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:05.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:05.891 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:05.889+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:06.026 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:06.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:06.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:06.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:06.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:06.881+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:07.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:07.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:07.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:07.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:07.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:07.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:08.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:08.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:08.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:08.508+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:08.900 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:08.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:09.077 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:09.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:09.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:09.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:09.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:09.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:10.045 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:10.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:10.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:10.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:10.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:10.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:11.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:11.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:11.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:11.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:11.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:11.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:12.054 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:12.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:12.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:12.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:12.892 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:12.888+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:13.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:13.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:13.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:13.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:13.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:13.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:14.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:14.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:14.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:14.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:14.874 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:14.872+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:15.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:15.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:15.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:15.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:15.881 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:15.876+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:16.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:16.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:16.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:16.492+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:16.861 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:16.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:17.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:17.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:17.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:17.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:17.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:17.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:18.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:18.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:18.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:18.436+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:18.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:18.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:19.000 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:18.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:19.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:19.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:19.870 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:19.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:20.042 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:20.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:20.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:20.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:20.848 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:20.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:21.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:21.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:21.393 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:21.388+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:21.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:21.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:21.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:21.980+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:22.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:22.352+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:22.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:22.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:23.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:23.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:23.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:23.340+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:23.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:23.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:24.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:24.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:24.388 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:24.384+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:24.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:24.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:25.018 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:25.012+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:25.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:25.348+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:25.847 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:25.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:25.988 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:25.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:26.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:26.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:26.851 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:26.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:27.001 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:26.996+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:27.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:27.364+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:27.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:27.808+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:28.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:28.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:28.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:28.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:28.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:28.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:28.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:28.972+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:29.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:29.380+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:29.889 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:29.884+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:30.006 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:30.004+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:30.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:30.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:30.884 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:30.880+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:31.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:31.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:31.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:31.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:31.846 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:31.840+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:32.043 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:32.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:32.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:32.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:32.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:32.864+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:33.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:33.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:33.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:33.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:33.818 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:33.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:34.051 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:34.048+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:34.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:34.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:34.795 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:34.792+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:35.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:35.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:35.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:35.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:35.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:35.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:36.063 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:36.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:36.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:36.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:36.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:36.756+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:37.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:37.016+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:37.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:37.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:37.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:37.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:38.049 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:38.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:38.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:38.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:38.780 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:38.776+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:39.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:39.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:39.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:39.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:39.738 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:39.732+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:40.057 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:40.052+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:40.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:40.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:40.744 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:40.740+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:41.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:41.044+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:41.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:41.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:41.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:41.708+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:42.023 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:42.020+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:42.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:42.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:42.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:42.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:42.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:42.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:43.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:43.488+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:43.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:43.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:44.044 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:44.040+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:44.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:44.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:44.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:44.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:45.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:45.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:45.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:45.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:45.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:45.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:46.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:46.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:46.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:46.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:46.675 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:46.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:47.112 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:47.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:47.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:47.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:47.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:47.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:48.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:48.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:48.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:48.528+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:48.667 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:48.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:49.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:49.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:49.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:49.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:49.635 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:49.632+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:50.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:50.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:50.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:50.500+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:50.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:50.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:51.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:51.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:51.485 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:51.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:51.671 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:51.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:52.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:52.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:52.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:52.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:52.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:52.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:53.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:53.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:53.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:53.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:53.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:53.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:54.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:54.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:54.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:54.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:54.615 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:54.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:55.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:55.107+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:55.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:55.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:55.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:55.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:56.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:56.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:56.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:56.483+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:56.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:56.587+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:57.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:57.135+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:57.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:57.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:57.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:57.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:58.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:58.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:58.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:58.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:58.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:58.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:59.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:24:59.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:24:59.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:24:59.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:24:59.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:24:59.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:00.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:00.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:00.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:00.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:00.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:00.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:01.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:01.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:01.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:01.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:01.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:01.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:02.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:02.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:02.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:02.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:02.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:02.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:03.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:03.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:03.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:03.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:03.533 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:03.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:04.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:04.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:04.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:04.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:04.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:04.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:05.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:05.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:05.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:05.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:05.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:05.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:06.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:06.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:06.464 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:06.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:06.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:06.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:07.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:07.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:07.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:07.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:07.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:07.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:08.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:08.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:08.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:08.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:08.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:08.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:09.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:09.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:09.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:09.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:09.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:09.499+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:10.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:10.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:10.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:10.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:10.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:10.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:11.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:11.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:11.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:11.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:11.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:11.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:12.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:12.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:12.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:12.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:12.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:12.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:13.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:13.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:13.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:13.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:13.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:13.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:14.116 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:14.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:14.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:14.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:14.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:14.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:15.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:15.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:15.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:15.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:15.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:15.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:16.189 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:16.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:16.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:16.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:16.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:16.679+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:17.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:17.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:17.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:17.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:17.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:17.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:18.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:18.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:18.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:18.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:18.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:18.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:19.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:19.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:19.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:19.583+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:19.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:19.651+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:20.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:20.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:20.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:20.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:20.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:20.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:21.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:21.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:21.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:21.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:21.674 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:21.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:22.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:22.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:22.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:22.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:22.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:22.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:23.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:23.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:23.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:23.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:23.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:23.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:24.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:24.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:24.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:24.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:24.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:24.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:25.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:25.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:25.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:25.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:25.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:25.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:26.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:26.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:26.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:26.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:26.697 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:26.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:27.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:27.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:27.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:27.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:27.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:27.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:28.181 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:28.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:28.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:28.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:28.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:28.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:29.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:29.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:29.494 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:29.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:29.715 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:29.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:30.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:30.235+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:30.512 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:30.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:30.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:30.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:31.207 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:31.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:31.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:31.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:31.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:31.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:32.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:32.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:32.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:32.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:32.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:32.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:33.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:33.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:33.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:33.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:33.712 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:33.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:34.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:34.299+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:34.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:34.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:34.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:34.703+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:35.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:35.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:35.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:35.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:35.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:35.719+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:36.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:36.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:36.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:36.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:36.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:36.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:37.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:37.219+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:37.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:37.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:37.738 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:37.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:38.206 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:38.199+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:38.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:38.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:38.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:38.687+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:39.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:39.195+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:39.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:39.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:39.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:39.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:40.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:40.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:40.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:40.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:40.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:40.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:41.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:41.214+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:41.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:41.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:41.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:41.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:42.253 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:42.246+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:42.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:42.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:42.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:42.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:43.289 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:43.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:43.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:43.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:43.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:43.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:44.287 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:44.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:44.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:44.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:44.654 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:44.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:45.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:45.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:45.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:45.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:45.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:45.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:46.329 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:46.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:46.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:46.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:46.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:46.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:47.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:47.342+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:47.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:47.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:47.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:47.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:48.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:48.310+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:48.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:48.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:48.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:48.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:49.274 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:49.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:49.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:49.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:49.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:49.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:50.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:50.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:50.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:50.478+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:50.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:50.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:51.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:51.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:51.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:51.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:51.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:51.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:52.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:52.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:52.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:52.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:52.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:52.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:53.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:53.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:53.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:53.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:53.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:53.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:54.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:54.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:54.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:54.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:54.559 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:54.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:55.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:55.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:55.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:55.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:55.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:55.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:56.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:56.238+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:56.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:56.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:56.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:56.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:57.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:57.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:57.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:57.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:57.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:57.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:58.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:58.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:58.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:58.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:25:58.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:58.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:59.257 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:25:59.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:59.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:25:59.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:25:59.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:25:59.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:00.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:00.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:00.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:00.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:00.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:00.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:01.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:01.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:01.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:01.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:01.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:01.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:02.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:02.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:02.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:02.442+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:02.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:02.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:03.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:03.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:03.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:03.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:03.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:03.510+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:04.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:04.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:04.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:04.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:04.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:04.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:05.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:05.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:05.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:05.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:05.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:05.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:06.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:06.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:06.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:06.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:06.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:06.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:07.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:07.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:07.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:07.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:07.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:07.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:08.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:08.198+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:08.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:08.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:08.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:08.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:09.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:09.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:09.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:09.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:09.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:09.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:10.180 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:10.174+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:10.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:10.506+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:10.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:10.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:11.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:11.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:11.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:11.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:11.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:11.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:12.130 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:12.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:12.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:12.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:12.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:12.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:13.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:13.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:13.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:13.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:13.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:13.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:14.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:14.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:14.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:14.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:14.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:14.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:15.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:15.098+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:15.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:15.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:15.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:15.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:16.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:16.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:16.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:16.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:16.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:16.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:17.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:17.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:17.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:17.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:17.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:17.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:18.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:18.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:18.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:18.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:18.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:18.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:19.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:19.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:19.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:19.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:19.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:19.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:20.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:20.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:20.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:20.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:20.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:20.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:21.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:21.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:21.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:21.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:21.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:21.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:22.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:22.142+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:22.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:22.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:22.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:22.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:23.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:23.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:23.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:23.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:23.643 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:23.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:24.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:24.186+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:24.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:24.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:24.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:24.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:25.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:25.166+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:25.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:25.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:25.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:25.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:26.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:26.170+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:26.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:26.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:26.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:26.677+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:27.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:27.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:27.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:27.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:27.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:27.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:28.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:28.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:28.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:28.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:28.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:28.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:29.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:29.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:29.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:29.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:29.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:29.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:30.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:30.253+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:30.348 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:30.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:30.740 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:30.733+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:31.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:31.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:31.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:31.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:31.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:31.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:32.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:32.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:32.364 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:32.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:32.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:32.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:33.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:33.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:33.317 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:33.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:33.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:33.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:34.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:34.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:34.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:34.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:34.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:34.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:35.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:35.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:35.345 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:35.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:35.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:35.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:36.267 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:36.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:36.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:36.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:36.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:36.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:37.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:37.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:37.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:37.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:37.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:37.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:38.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:38.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:38.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:38.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:38.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:38.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:39.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:39.289+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:39.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:39.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:39.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:39.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:40.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:40.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:40.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:40.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:40.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:40.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:41.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:41.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:41.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:41.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:41.644 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:41.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:42.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:42.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:42.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:42.409+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:42.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:42.605+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:43.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:43.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:43.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:43.389+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:43.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:43.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:44.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:44.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:44.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:44.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:44.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:44.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:45.332 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:45.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:45.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:45.373+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:45.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:45.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:46.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:46.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:46.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:46.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:46.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:46.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:47.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:47.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:47.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:47.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:47.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:47.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:48.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:48.425+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:48.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:48.441+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:48.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:48.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:49.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:49.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:49.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:49.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:49.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:49.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:50.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:50.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:50.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:50.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:50.805 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:50.801+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:51.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:51.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:51.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:51.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:51.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:51.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:52.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:52.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:52.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:52.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:52.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:52.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:53.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:53.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:53.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:53.557+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:53.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:53.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:54.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:54.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:54.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:54.553+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:54.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:54.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:55.351 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:55.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:55.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:55.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:55.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:55.657+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:56.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:56.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:56.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:56.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:56.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:56.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:57.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:57.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:57.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:57.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:57.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:57.705+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:58.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:58.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:58.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:58.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:58.693 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:58.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:59.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:26:59.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:26:59.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:26:59.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:26:59.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:26:59.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:00.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:00.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:00.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:00.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:00.713 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:00.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:01.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:01.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:01.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:01.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:01.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:01.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:02.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:02.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:02.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:02.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:02.733 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:02.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:03.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:03.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:03.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:03.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:03.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:03.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:04.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:04.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:04.527 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:04.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:04.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:04.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:05.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:05.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:05.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:05.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:05.760 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:05.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:06.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:06.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:06.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:06.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:06.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:06.753+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:07.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:07.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:07.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:07.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:07.732 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:07.729+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:08.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:08.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:08.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:08.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:08.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:08.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:09.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:09.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:09.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:09.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:09.746 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:09.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:10.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:10.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:10.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:10.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:10.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:10.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:11.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:11.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:11.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:11.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:11.663 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:11.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:12.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:12.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:12.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:12.509+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:12.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:12.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:13.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:13.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:13.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:13.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:13.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:13.636+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:14.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:14.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:14.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:14.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:14.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:14.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:15.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:15.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:15.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:15.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:15.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:15.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:16.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:16.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:16.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:16.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:16.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:16.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:17.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:17.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:17.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:17.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:17.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:17.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:18.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:18.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:18.582 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:18.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:18.688 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:18.684+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:19.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:19.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:19.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:19.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:19.648 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:19.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:20.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:20.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:20.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:20.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:20.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:20.660+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:21.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:21.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:21.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:21.668+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:21.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:21.704+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:22.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:22.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:22.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:22.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:22.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:22.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:23.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:23.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:23.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:23.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:23.711 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:23.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:24.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:24.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:24.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:24.636+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:24.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:24.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:25.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:25.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:25.617 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:25.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:25.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:25.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:26.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:26.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:26.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:26.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:26.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:26.704+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:27.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:27.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:27.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:27.612+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:27.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:27.744+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:28.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:28.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:28.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:28.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:28.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:28.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:29.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:29.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:29.624 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:29.620+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:29.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:29.728+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:30.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:30.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:30.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:30.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:30.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:30.728+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:31.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:31.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:31.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:31.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:31.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:31.780+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:32.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:32.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:32.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:32.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:32.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:32.752+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:33.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:33.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:33.583 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:33.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:33.738 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:33.732+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:34.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:34.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:34.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:34.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:34.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:34.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:35.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:35.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:35.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:35.592+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:35.752 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:35.748+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:36.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:36.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:36.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:36.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:36.774 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:36.772+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:37.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:37.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:37.591 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:37.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:37.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:37.768+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:38.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:38.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:38.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:38.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:38.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:38.804+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:39.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:39.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:39.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:39.640+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:39.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:39.788+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:40.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:40.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:40.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:40.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:40.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:40.792+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:41.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:41.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:41.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:41.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:41.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:41.828+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:42.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:42.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:42.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:42.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:42.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:42.824+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:43.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:43.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:43.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:43.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:43.819 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:43.816+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:44.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:44.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:44.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:44.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:44.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:44.848+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:45.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:45.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:45.555 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:45.552+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:45.837 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:45.832+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:46.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:46.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:46.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:46.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:46.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:46.824+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:47.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:47.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:47.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:47.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:47.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:47.836+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:48.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:48.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:48.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:48.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:48.862 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:48.856+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:49.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:49.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:49.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:49.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:49.824 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:49.820+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:50.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:50.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:50.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:50.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:50.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:50.844+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:51.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:51.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:51.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:51.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:51.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:51.860+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:52.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:52.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:52.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:52.568+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:52.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:52.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:53.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:53.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:53.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:53.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:53.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:53.928+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:54.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:54.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:54.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:54.588+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:54.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:54.916+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:55.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:55.508+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:55.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:55.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:55.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:55.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:56.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:56.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:56.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:56.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:56.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:56.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:57.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:57.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:57.581 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:57.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:57.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:57.984+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:58.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:58.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:58.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:58.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:58.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:58.995+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:59.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:27:59.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:27:59.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:27:59.583+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:27:59.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:27:59.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:00.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:00.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:00.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:00.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:00.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:00.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:01.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:01.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:01.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:01.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:01.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:01.923+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:02.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:02.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:02.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:02.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:02.947 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:02.943+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:03.571 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:03.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:03.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:03.599+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:03.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:03.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:04.532 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:04.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:04.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:04.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:04.958 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:04.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:05.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:05.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:05.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:05.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:05.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:05.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:06.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:06.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:06.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:06.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:06.943 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:06.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:07.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:07.595+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:07.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:07.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:07.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:07.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:08.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:08.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:08.623 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:08.619+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:08.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:08.951+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:09.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:09.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:09.636 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:09.631+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:09.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:09.919+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:10.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:10.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:10.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:10.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:10.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:10.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:11.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:11.627+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:11.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:11.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:11.890 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:11.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:12.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:12.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:12.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:12.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:12.921 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:12.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:13.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:13.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:13.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:13.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:13.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:13.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:14.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:14.639+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:14.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:14.715+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:14.908 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:14.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:15.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:15.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:15.717 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:15.711+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:15.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:15.899+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:16.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:16.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:16.682 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:16.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:16.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:16.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:17.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:17.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:17.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:17.643+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:17.901 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:17.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:18.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:18.599+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:18.639 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:18.635+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:18.882 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:18.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:19.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:19.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:19.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:19.623+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:19.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:19.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:20.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:20.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:20.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:20.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:20.906 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:20.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:21.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:21.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:21.678 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:21.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:21.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:21.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:22.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:22.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:22.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:22.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:22.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:22.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:23.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:23.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:23.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:23.655+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:23.844 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:23.839+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:24.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:24.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:24.651 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:24.647+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:24.843 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:24.839+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:25.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:25.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:25.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:25.691+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:25.880 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:25.875+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:26.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:26.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:26.672 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:26.667+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:26.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:26.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:27.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:27.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:27.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:27.659+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:27.889 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:27.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:28.522 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:28.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:28.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:28.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:28.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:28.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:29.489 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:29.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:29.669 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:29.663+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:29.982 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:29.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:30.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:30.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:30.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:30.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:30.936 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:30.931+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:31.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:31.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:31.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:31.723+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:31.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:31.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:32.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:32.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:32.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:32.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:32.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:32.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:33.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:33.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:33.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:33.707+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:33.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:33.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:34.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:34.499+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:34.756 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:34.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:34.870 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:34.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:35.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:35.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:35.737 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:35.731+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:35.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:35.907+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:36.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:36.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:36.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:36.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:36.928 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:36.923+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:37.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:37.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:37.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:37.799+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:37.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:37.963+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:38.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:38.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:38.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:38.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:39.008 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:39.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:39.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:39.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:39.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:39.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:39.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:39.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:40.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:40.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:40.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:40.743+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:40.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:40.955+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:41.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:41.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:41.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:41.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:41.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:41.923+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:42.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:42.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:42.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:42.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:42.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:42.959+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:43.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:43.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:43.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:43.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:43.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:43.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:44.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:44.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:44.812 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:44.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:44.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:44.935+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:45.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:45.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:45.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:45.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:45.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:45.938+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:46.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:46.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:46.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:46.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:46.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:46.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:47.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:47.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:47.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:47.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:47.941 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:47.934+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:48.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:48.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:48.768 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:48.762+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:48.991 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:48.986+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:49.447 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:49.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:49.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:49.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:50.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:50.022+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:50.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:50.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:50.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:50.758+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:51.073 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:51.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:51.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:51.386+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:51.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:51.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:52.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:52.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:52.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:52.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:52.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:52.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:53.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:53.118+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:53.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:53.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:53.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:53.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:54.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:54.134+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:54.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:54.382+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:54.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:54.742+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:55.134 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:55.126+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:55.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:55.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:55.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:55.710+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:56.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:56.138+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:56.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:56.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:56.671 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:56.666+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:57.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:57.130+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:57.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:57.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:57.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:57.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:58.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:58.086+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:58.344 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:58.338+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:58.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:58.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:59.085 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:28:59.078+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:28:59.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:28:59.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:28:59.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:28:59.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:00.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:00.090+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:00.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:00.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:00.635 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:00.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:01.068 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:01.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:01.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:01.242+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:01.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:01.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:02.059 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:02.054+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:02.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:02.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:02.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:02.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:03.022 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:03.014+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:03.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:03.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:03.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:03.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:03.975 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:03.970+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:04.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:04.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:04.612 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:04.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:05.008 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:05.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:05.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:05.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:05.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:05.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:06.037 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:06.030+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:06.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:06.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:06.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:06.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:07.007 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:07.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:07.152 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:07.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:07.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:07.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:07.962 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:07.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:08.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:08.138+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:08.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:08.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:08.927 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:08.922+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:09.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:09.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:09.610 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:09.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:09.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:09.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:10.096 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:10.090+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:10.572 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:10.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:10.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:10.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:11.108 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:11.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:11.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:11.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:11.929 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:11.922+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:12.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:12.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:12.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:12.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:12.893 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:12.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:13.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:13.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:13.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:13.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:13.895 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:13.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:14.165 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:14.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:14.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:14.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:14.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:14.934+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:15.155 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:15.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:15.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:15.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:15.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:15.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:16.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:16.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:16.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:16.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:16.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:16.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:17.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:17.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:17.587 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:17.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:17.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:17.878+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:18.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:18.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:18.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:18.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:18.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:18.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:19.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:19.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:19.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:19.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:19.816 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:19.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:20.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:20.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:20.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:20.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:20.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:20.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:21.159 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:21.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:21.596 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:21.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:21.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:21.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:22.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:22.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:22.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:22.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:22.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:22.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:23.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:23.222+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:23.632 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:23.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:23.847 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:23.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:24.182 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:24.174+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:24.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:24.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:24.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:24.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:25.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:25.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:25.681 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:25.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:25.894 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:25.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:26.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:26.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:26.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:26.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:26.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:26.894+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:27.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:27.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:27.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:27.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:27.919 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:27.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:28.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:28.118+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:28.727 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:28.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:28.932 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:28.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:29.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:29.098+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:29.758 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:29.754+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:29.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:29.946+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:30.128 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:30.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:30.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:30.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:30.922 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:30.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:31.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:31.130+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:31.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:31.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:31.949 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:31.941+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:32.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:32.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:32.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:32.821+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:32.986 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:32.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:33.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:33.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:33.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:33.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:34.035 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:34.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:34.125 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:34.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:34.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:34.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:35.020 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:35.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:35.164 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:35.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:35.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:35.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:36.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:36.061+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:36.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:36.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:36.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:36.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:37.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:37.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:37.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:37.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:37.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:37.757+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:38.017 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:38.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:38.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:38.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:38.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:38.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:38.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:38.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:39.151 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:39.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:39.797 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:39.789+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:39.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:39.953+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:40.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:40.117+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:40.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:40.813+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:40.925 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:40.917+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:41.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:41.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:41.851 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:41.845+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:41.942 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:41.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:42.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:42.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:42.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:42.893+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:42.940 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:42.937+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:43.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:43.133+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:43.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:43.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:43.965 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:43.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:44.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:44.161+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:44.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:44.949+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:45.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:45.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:45.205 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:45.201+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:46.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:46.001+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:46.024 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:46.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:46.219 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:46.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:46.984 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:46.981+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:47.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:47.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:47.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:47.253+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:48.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:48.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:48.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:48.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:48.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:48.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:49.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:49.041+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:49.058 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:49.053+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:49.277 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:49.273+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:50.048 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:50.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:50.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:50.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:50.281 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:50.277+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:51.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:51.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:51.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:51.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:51.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:51.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:52.025 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:52.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:52.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:52.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:52.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:52.341+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:53.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:53.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:53.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:53.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:53.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:53.305+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:54.080 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:54.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:54.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:54.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:54.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:54.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:55.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:55.117+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:55.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:55.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:55.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:55.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:56.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:56.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:56.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:56.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:56.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:56.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:57.064 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:57.061+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:57.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:57.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:57.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:57.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:58.112 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:58.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:58.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:58.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:58.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:58.349+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:29:59.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:29:59.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:59.162 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:29:59.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:29:59.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:29:59.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:00.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:00.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:00.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:00.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:00.381 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:00.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:01.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:01.097+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:01.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:01.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:01.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:01.361+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:02.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:02.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:02.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:02.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:02.381 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:02.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:03.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:03.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:03.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:03.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:03.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:03.401+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:04.090 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:04.085+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:04.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:04.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:04.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:04.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:05.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:05.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:05.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:05.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:05.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:05.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:06.111 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:06.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:06.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:06.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:06.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:06.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:07.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:07.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:07.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:07.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:07.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:07.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:08.026 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:08.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:08.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:08.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:08.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:08.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:09.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:09.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:09.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:09.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:09.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:09.469+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:10.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:10.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:10.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:10.281+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:10.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:10.421+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:11.051 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:11.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:11.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:11.325+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:11.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:11.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:12.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:12.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:12.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:12.333+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:12.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:12.437+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:13.047 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:13.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:13.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:13.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:13.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:13.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:14.074 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:14.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:14.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:14.325+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:14.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:14.457+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:15.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:15.109+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:15.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:15.289+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:15.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:15.485+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:16.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:16.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:16.318 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:16.317+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:16.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:16.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:17.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:17.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:17.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:17.345+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:17.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:17.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:18.021 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:18.016+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:18.304 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:18.300+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:18.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:18.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:19.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:18.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:19.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:19.312+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:19.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:19.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:19.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:19.984+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:20.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:20.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:20.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:20.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:20.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:20.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:21.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:21.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:21.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:21.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:21.892 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:21.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:22.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:22.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:22.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:22.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:22.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:22.936+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:23.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:23.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:23.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:23.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:23.930 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:23.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:24.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:24.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:24.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:24.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:24.903 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:24.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:25.302 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:25.296+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:25.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:25.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:25.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:25.864+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:26.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:26.264+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:26.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:26.504+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:26.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:26.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:27.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:27.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:27.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:27.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:27.864 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:27.860+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:28.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:28.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:28.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:28.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:28.895 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:28.892+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:29.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:29.216+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:29.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:29.500+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:29.906 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:29.904+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:30.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:30.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:30.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:30.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:30.871 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:30.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:31.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:31.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:31.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:31.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:31.836 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:31.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:32.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:32.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:32.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:32.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:32.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:32.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:33.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:33.268+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:33.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:33.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:33.807 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:33.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:34.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:34.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:34.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:34.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:34.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:34.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:35.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:35.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:35.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:35.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:35.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:35.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:36.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:36.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:36.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:36.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:36.838 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:36.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:37.326 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:37.324+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:37.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:37.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:37.846 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:37.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:38.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:38.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:38.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:38.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:38.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:38.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:39.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:39.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:39.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:39.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:39.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:39.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:40.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:40.312+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:40.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:40.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:40.831 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:40.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:41.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:41.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:41.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:41.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:41.849 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:41.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:42.303 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:42.300+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:42.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:42.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:42.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:42.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:43.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:43.340+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:43.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:43.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:43.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:43.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:44.335 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:44.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:44.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:44.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:44.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:44.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:45.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:45.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:45.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:45.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:45.853 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:45.848+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:46.284 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:46.280+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:46.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:46.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:46.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:46.824+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:47.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:47.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:47.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:47.496+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:47.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:47.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:48.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:48.292+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:48.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:48.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:48.815 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:48.812+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:49.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:49.288+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:49.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:49.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:49.862 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:49.856+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:50.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:50.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:50.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:50.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:50.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:50.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:51.347 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:51.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:51.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:51.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:51.872 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:51.868+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:52.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:52.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:52.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:52.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:52.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:52.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:53.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:53.360+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:53.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:53.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:53.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:53.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:54.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:54.364+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:54.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:54.448+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:54.798 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:54.792+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:55.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:55.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:55.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:55.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:55.761 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:55.756+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:56.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:56.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:56.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:56.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:56.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:56.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:57.374 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:57.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:57.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:57.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:57.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:57.852+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:58.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:58.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:58.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:58.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:58.867 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:58.864+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:59.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:30:59.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:30:59.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:30:59.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:30:59.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:30:59.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:00.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:00.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:00.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:00.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:00.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:00.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:01.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:01.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:01.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:01.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:01.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:01.832+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:02.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:02.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:02.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:02.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:02.843 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:02.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:03.294 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:03.288+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:03.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:03.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:03.833 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:03.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:04.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:04.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:04.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:04.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:04.787 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:04.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:05.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:05.303+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:05.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:05.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:05.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:05.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:06.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:06.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:06.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:06.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:06.775 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:06.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:07.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:07.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:07.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:07.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:07.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:07.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:08.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:08.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:08.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:08.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:08.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:08.827+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:09.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:09.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:09.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:09.515+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:09.877 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:09.871+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:10.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:10.283+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:10.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:10.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:10.911 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:10.907+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:11.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:11.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:11.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:11.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:11.898 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:11.891+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:12.262 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:12.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:12.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:12.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:12.912 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:12.907+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:13.274 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:13.267+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:13.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:13.563+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:13.887 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:13.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:14.243 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:14.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:14.582 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:14.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:14.859 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:14.855+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:15.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:15.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:15.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:15.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:15.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:15.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:16.282 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:16.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:16.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:16.551+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:16.810 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:16.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:17.260 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:17.255+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:17.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:17.575+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:17.856 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:17.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:18.235 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:18.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:18.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:18.563+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:18.820 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:18.815+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:19.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:19.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:19.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:19.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:19.800 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:19.795+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:20.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:20.175+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:20.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:20.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:20.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:20.751+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:21.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:21.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:21.565 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:21.559+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:21.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:21.783+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:22.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:22.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:22.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:22.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:22.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:22.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:23.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:23.135+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:23.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:23.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:23.781 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:23.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:24.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:24.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:24.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:24.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:24.796 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:24.791+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:25.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:25.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:25.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:25.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:25.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:25.779+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:26.094 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:26.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:26.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:26.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:26.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:26.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:27.126 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:27.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:27.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:27.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:27.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:27.775+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:28.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:28.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:28.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:28.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:28.822 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:28.819+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:29.092 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:29.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:29.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:29.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:29.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:29.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:30.105 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:30.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:30.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:30.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:30.890 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:30.883+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:31.098 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:31.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:31.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:31.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:31.927 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:31.923+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:32.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:32.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:32.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:32.471+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:32.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:32.959+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:33.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:33.027+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:33.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:33.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:33.938 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:33.931+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:34.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:34.015+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:34.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:34.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:34.963 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:34.959+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:35.008 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:35.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:35.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:35.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:35.956 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:35.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:35.999 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:35.995+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:36.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:36.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:36.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:36.915+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:36.993 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:36.987+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:37.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:37.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:37.924 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:37.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:38.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:38.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:38.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:38.471+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:38.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:38.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:39.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:39.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:39.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:39.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:39.967 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:39.963+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:40.016 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:40.011+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:40.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:40.507+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:40.998 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:40.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:41.062 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:41.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:41.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:41.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:41.997 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:41.991+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:42.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:42.063+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:42.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:42.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:43.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:43.039+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:43.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:43.063+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:43.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:43.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:44.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:44.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:44.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:44.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:44.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:44.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:45.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:45.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:45.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:45.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:45.452 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:45.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:46.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:46.039+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:46.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:46.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:46.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:46.451+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:47.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:47.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:47.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:47.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:47.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:47.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:48.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:48.031+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:48.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:48.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:48.500 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:48.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:49.041 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:49.035+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:49.084 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:49.079+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:49.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:49.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:50.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:50.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:50.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:50.102+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:50.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:50.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:51.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:51.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:51.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:51.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:51.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:51.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:52.044 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:52.038+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:52.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:52.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:52.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:52.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:53.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:53.034+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:53.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:53.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:53.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:53.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:54.019 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:54.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:54.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:54.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:54.603 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:54.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:55.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:55.038+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:55.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:55.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:55.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:55.594+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:56.082 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:56.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:56.113 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:56.106+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:56.650 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:56.642+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:57.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:57.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:57.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:57.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:57.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:57.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:58.057 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:58.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:58.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:58.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:58.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:58.646+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:59.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:31:59.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:31:59.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:31:59.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:31:59.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:31:59.650+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:00.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:00.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:00.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:00.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:00.661 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:00.654+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:01.106 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:01.098+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:01.187 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:01.182+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:01.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:01.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:02.118 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:02.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:02.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:02.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:02.595 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:02.590+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:03.077 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:03.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:03.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:03.178+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:03.627 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:03.622+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:04.039 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:04.034+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:04.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:04.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:04.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:04.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:05.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:05.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:05.173 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:05.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:05.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:05.598+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:06.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:06.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:06.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:06.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:06.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:06.610+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:06.987 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:06.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:07.199 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:07.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:07.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:07.662+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:07.969 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:07.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:08.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:08.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:08.640 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:08.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:08.982 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:08.974+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:09.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:09.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:09.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:09.654+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:09.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:09.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:10.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:10.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:10.662 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:10.654+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:10.953 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:10.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:11.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:11.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:11.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:11.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:11.963 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:11.958+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:12.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:12.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:12.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:12.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:12.997 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:12.990+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:13.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:13.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:13.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:13.634+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:14.014 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:14.006+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:14.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:14.258+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:14.626 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:14.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:14.988 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:14.982+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:15.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:15.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:15.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:15.614+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:16.005 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:15.998+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:16.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:16.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:16.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:16.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:17.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:17.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:17.284 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:17.278+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:17.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:17.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:18.058 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:18.050+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:18.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:18.242+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:18.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:18.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:19.084 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:19.078+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:19.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:19.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:19.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:19.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:20.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:20.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:20.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:20.194+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:20.555 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:20.550+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:21.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:21.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:21.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:21.178+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:21.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:21.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:22.093 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:22.086+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:22.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:22.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:22.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:22.498+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:23.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:23.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:23.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:23.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:23.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:23.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:24.157 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:24.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:24.160 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:24.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:24.463 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:24.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:25.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:25.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:25.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:25.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:25.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:25.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:26.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:26.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:26.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:26.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:26.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:26.426+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:27.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:27.146+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:27.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:27.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:27.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:27.466+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:28.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:28.198+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:28.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:28.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:28.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:28.450+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:29.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:29.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:29.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:29.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:29.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:29.434+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:30.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:30.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:30.224 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:30.218+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:30.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:30.430+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:31.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:31.134+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:31.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:31.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:31.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:31.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:32.129 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:32.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:32.257 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:32.250+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:32.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:32.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:33.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:33.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:33.214 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:33.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:33.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:33.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:34.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:34.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:34.202 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:34.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:34.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:34.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:35.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:35.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:35.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:35.206+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:35.522 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:35.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:36.116 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:36.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:36.253 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:36.245+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:36.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:36.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:37.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:37.149+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:37.204 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:37.197+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:37.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:37.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:38.197 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:38.189+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:38.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:38.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:38.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:38.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:39.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:39.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:39.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:39.169+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:39.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:39.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:40.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:40.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:40.143 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:40.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:40.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:40.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:41.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:41.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:41.186 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:41.177+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:41.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:41.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:42.174 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:42.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:42.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:42.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:42.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:42.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:43.134 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:43.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:43.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:43.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:43.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:43.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:44.148 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:44.141+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:44.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:44.233+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:44.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:44.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:45.137 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:45.129+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:45.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:45.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:45.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:45.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:46.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:46.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:46.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:46.181+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:46.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:46.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:47.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:47.161+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:47.167 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:47.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:47.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:47.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:48.117 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:48.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:48.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:48.169+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:48.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:48.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:49.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:49.117+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:49.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:49.209+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:49.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:49.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:50.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:50.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:50.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:50.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:50.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:50.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:51.092 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:51.089+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:51.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:51.233+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:51.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:51.389+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:52.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:52.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:52.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:52.285+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:52.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:52.433+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:53.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:53.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:53.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:53.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:53.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:53.425+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:54.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:54.093+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:54.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:54.265+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:54.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:54.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:55.076 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:55.073+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:55.251 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:55.249+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:55.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:55.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:56.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:56.117+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:56.298 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:56.293+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:56.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:56.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:57.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:57.161+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:57.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:57.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:57.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:57.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:58.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:58.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:58.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:58.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:58.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:58.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:59.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:32:59.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:32:59.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:32:59.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:32:59.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:32:59.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:00.171 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:00.169+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:00.357 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:00.353+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:00.517 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:00.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:01.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:01.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:01.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:01.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:01.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:01.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:02.191 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:02.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:02.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:02.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:02.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:02.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:03.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:03.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:03.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:03.465+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:03.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:03.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:04.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:04.225+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:04.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:04.433+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:04.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:04.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:05.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:05.241+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:05.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:05.441+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:05.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:05.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:06.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:06.197+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:06.464 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:06.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:06.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:06.461+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:07.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:07.221+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:07.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:07.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:07.511 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:07.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:08.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:08.241+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:08.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:08.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:08.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:08.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:09.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:09.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:09.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:09.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:09.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:09.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:10.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:10.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:10.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:10.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:10.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:10.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:11.277 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:11.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:11.477 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:11.473+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:11.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:11.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:12.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:12.293+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:12.508 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:12.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:12.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:12.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:13.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:13.321+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:13.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:13.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:13.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:13.565+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:14.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:14.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:14.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:14.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:14.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:14.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:15.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:15.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:15.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:15.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:15.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:15.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:16.309 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:16.305+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:16.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:16.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:16.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:16.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:17.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:17.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:17.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:17.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:17.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:17.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:18.301 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:18.297+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:18.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:18.513+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:18.667 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:18.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:19.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:19.349+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:19.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:19.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:19.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:19.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:20.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:20.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:20.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:20.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:20.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:20.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:21.335 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:21.333+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:21.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:21.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:21.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:21.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:22.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:22.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:22.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:22.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:22.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:22.644+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:23.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:23.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:23.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:23.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:23.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:23.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:24.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:24.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:24.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:24.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:24.584 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:24.580+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:25.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:25.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:25.463 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:25.460+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:25.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:25.548+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:26.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:26.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:26.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:26.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:26.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:26.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:27.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:27.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:27.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:27.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:27.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:27.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:28.287 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:28.284+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:28.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:28.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:28.506 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:28.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:29.325 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:29.320+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:29.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:29.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:29.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:29.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:30.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:30.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:30.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:30.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:30.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:30.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:31.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:31.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:31.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:31.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:31.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:31.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:32.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:32.292+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:32.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:32.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:32.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:32.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:33.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:33.288+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:33.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:33.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:33.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:33.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:34.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:34.276+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:34.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:34.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:34.415 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:34.412+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:35.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:35.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:35.314 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:35.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:35.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:35.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:36.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:36.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:36.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:36.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:36.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:36.408+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:37.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:37.212+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:37.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:37.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:37.386 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:37.380+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:38.244 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:38.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:38.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:38.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:38.427 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:38.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:39.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:39.260+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:39.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:39.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:39.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:39.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:40.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:40.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:40.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:40.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:40.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:40.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:41.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:41.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:41.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:41.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:41.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:41.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:42.232 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:42.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:42.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:42.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:42.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:42.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:43.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:43.252+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:43.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:43.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:43.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:43.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:44.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:44.244+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:44.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:44.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:44.519 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:44.516+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:45.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:45.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:45.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:45.320+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:45.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:45.516+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:46.252 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:46.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:46.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:46.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:46.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:46.552+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:47.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:47.212+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:47.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:47.328+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:47.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:47.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:48.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:48.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:48.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:48.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:48.563 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:48.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:49.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:49.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:49.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:49.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:49.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:49.528+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:50.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:50.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:50.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:50.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:50.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:50.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:51.187 INFO:tasks.workunit.client.0.smithi196.stderr:2023-11-08T19:33:51.184+0000 7fbc7ffff700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh (PID: 33471) UID: 1000 2023-11-08T19:33:51.188 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-08T19:33:51.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:51.212+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:51.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:51.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:51.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:51.496+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:52.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:52.168+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:52.313 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:52.308+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:52.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:52.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:53.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:53.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:53.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:53.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:53.433 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:53.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:54.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:54.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:54.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:54.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:54.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:54.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:55.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:55.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:55.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:55.312+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:55.376 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:55.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:56.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:56.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:56.275 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:56.272+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:56.345 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:56.340+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:57.228 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:57.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:57.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:57.292+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:57.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:57.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:58.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:58.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:58.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:58.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:58.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:58.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:33:59.216 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:33:59.212+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:59.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:33:59.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:33:59.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:33:59.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:00.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:00.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:00.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:00.324+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:00.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:00.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:01.204 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:01.200+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:01.280 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:01.276+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:01.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:01.340+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:02.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:02.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:02.258 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:02.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:02.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:02.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:03.230 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:03.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:03.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:03.268+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:03.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:03.348+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:04.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:04.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:04.271 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:04.268+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:04.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:04.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:05.259 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:05.256+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:05.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:05.272+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:05.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:05.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:06.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:06.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:06.320 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:06.316+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:06.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:06.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:07.278 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:07.272+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:07.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:07.292+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:07.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:07.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:08.231 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:08.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:08.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:08.268+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:08.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:08.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:09.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:09.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:09.285 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:09.279+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:09.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:09.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:10.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:10.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:10.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:10.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:10.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:10.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:11.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:11.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:11.328 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:11.323+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:11.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:11.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:12.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:12.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:12.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:12.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:12.451 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:12.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:13.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:13.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:13.333 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:13.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:13.456 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:13.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:14.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:14.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:14.372 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:14.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:14.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:14.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:15.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:15.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:15.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:15.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:15.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:15.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:16.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:16.327+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:16.369 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:16.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:16.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:16.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:17.296 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:17.291+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:17.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:17.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:17.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:17.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:18.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:18.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:18.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:18.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:18.471 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:18.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:19.299 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:19.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:19.383 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:19.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:19.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:19.419+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:20.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:20.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:20.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:20.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:20.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:20.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:21.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:21.371+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:21.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:21.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:21.389 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:21.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:22.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:22.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:22.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:22.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:22.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:22.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:23.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:23.403+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:23.413 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:23.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:23.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:23.419+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:24.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:24.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:24.421 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:24.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:24.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:24.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:25.392 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:25.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:25.404 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:25.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:25.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:25.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:26.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:26.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:26.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:26.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:26.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:26.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:27.368 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:27.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:27.401 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:27.395+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:27.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:27.443+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:28.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:28.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:28.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:28.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:28.446 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:28.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:29.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:29.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:29.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:29.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:29.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:29.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:30.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:30.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:30.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:30.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:30.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:30.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:31.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:31.295+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:31.418 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:31.411+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:31.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:31.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:32.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:32.291+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:32.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:32.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:32.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:32.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:33.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:33.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:33.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:33.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:33.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:33.491+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:34.285 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:34.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:34.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:34.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:34.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:34.467+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:35.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:35.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:35.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:35.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:35.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:35.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:36.284 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:36.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:36.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:36.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:36.449 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:36.443+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:37.319 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:37.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:37.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:37.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:37.426 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:37.419+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:38.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:38.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:38.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:38.363+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:38.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:38.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:39.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:39.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:39.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:39.391+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:39.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:39.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:40.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:40.367+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:40.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:40.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:40.459 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:40.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:41.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:41.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:41.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:41.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:41.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:41.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:42.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:42.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:42.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:42.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:42.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:42.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:43.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:43.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:43.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:43.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:43.467 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:43.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:44.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:44.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:44.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:44.411+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:44.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:44.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:45.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:45.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:45.395 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:45.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:45.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:45.427+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:46.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:46.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:46.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:46.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:46.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:46.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:47.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:47.315+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:47.396 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:47.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:47.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:47.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:48.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:48.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:48.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:48.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:48.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:48.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:49.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:49.335+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:49.369 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:49.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:49.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:49.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:50.293 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:50.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:50.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:50.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:50.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:50.419+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:51.190 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-11-08T19:34:51.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:51.319+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:51.404 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:51.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:51.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:51.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:52.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:52.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:52.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:52.415+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:52.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:52.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:53.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:53.287+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:53.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:53.407+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:53.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:53.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:54.327 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:54.323+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:54.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:54.447+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:54.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:54.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:55.298 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:55.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:55.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:55.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:55.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:55.486+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:56.323 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:56.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:56.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:56.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:56.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:56.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:57.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:57.334+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:57.502 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:57.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:57.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:57.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:58.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:58.374+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:58.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:58.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:58.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:58.526+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:59.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:34:59.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:34:59.497 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:34:59.490+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:34:59.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:34:59.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:00.422 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:00.414+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:00.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:00.494+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:00.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:00.550+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:01.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:01.406+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:01.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:01.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:01.595 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:01.590+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:02.397 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:02.390+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:02.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:02.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:02.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:02.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:03.369 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:03.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:03.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:03.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:03.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:03.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:04.342 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:04.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:04.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:04.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:04.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:04.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:05.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:05.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:05.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:05.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:05.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:05.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:06.338 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:06.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:06.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:06.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:06.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:06.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:07.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:07.366+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:07.452 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:07.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:07.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:07.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:08.418 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:08.410+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:08.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:08.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:08.710 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:08.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:09.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:09.418+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:09.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:09.438+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:09.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:09.714+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:10.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:10.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:10.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:10.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:10.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:10.714+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:11.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:11.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:11.477 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:11.470+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:11.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:11.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:12.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:12.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:12.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:12.506+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:12.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:12.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:13.521 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:13.514+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:13.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:13.534+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:13.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:13.750+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:14.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:14.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:14.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:14.574+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:14.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:14.802+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:15.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:15.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:15.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:15.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:15.777 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:15.770+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:16.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:16.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:16.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:16.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:16.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:16.778+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:17.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:17.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:17.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:17.602+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:17.744 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:17.738+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:18.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:18.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:18.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:18.614+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:18.707 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:18.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:19.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:19.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:19.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:19.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:19.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:19.702+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:20.486 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:20.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:20.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:20.586+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:20.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:20.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:21.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:21.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:21.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:21.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:21.696 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:21.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:22.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:22.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:22.575 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:22.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:22.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:22.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:23.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:23.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:23.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:23.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:23.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:23.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:24.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:24.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:24.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:24.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:24.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:24.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:25.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:25.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:25.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:25.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:25.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:25.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:26.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:26.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:26.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:26.578+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:26.664 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:26.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:27.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:27.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:27.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:27.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:27.690 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:27.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:28.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:28.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:28.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:28.518+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:28.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:28.646+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:29.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:29.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:29.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:29.530+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:29.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:29.690+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:30.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:30.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:30.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:30.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:30.729 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:30.722+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:31.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:31.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:31.523 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:31.518+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:31.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:31.746+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:32.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:32.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:32.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:32.558+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:32.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:32.786+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:33.520 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:33.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:33.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:33.570+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:33.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:33.814+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:34.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:34.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:34.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:34.534+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:34.823 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:34.818+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:35.553 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:35.546+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:35.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:35.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:35.780 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:35.774+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:36.551 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:36.546+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:36.557 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:36.550+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:36.772 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:36.766+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:37.567 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:37.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:37.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:37.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:37.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:37.718+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:38.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:38.582+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:38.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:38.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:38.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:38.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:39.561 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:39.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:39.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:39.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:39.735 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:39.730+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:40.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:40.578+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:40.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:40.642+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:40.702 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:40.694+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:41.630 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:41.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:41.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:41.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:41.720 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:41.713+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:42.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:42.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:42.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:42.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:42.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:42.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:43.611 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:43.605+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:43.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:43.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:43.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:43.669+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:44.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:44.633+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:44.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:44.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:44.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:44.673+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:45.672 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:45.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:45.685 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:45.677+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:45.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:45.681+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:46.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:46.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:46.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:46.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:46.652 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:46.645+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:47.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:47.589+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:47.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:47.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:47.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:47.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:48.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:48.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:48.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:48.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:48.650 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:48.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:49.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:49.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:49.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:49.629+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:49.673 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:49.665+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:50.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:50.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:50.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:50.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:50.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:50.649+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:51.191 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-11-08T19:35:51.192 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-11-08T19:35:51.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-11-08T19:35:51.444 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-11-08T19:35:51.534 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c190a677f3c2429187d949cc97620a62 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-11-08T19:35:51.537 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-08T19:35:51.548 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-11-08T19:35:51.548 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:35:51.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:51.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:51.647 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:51.641+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:51.653 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:51.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:51.840 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:35:51.840 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":158,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T17:36:46.776114+0000","last_up_change":"2023-11-08T16:32:48.264488+0000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-08T16:32:48.330442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T16:32:48.682940+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-11-08T16:32:55.131120+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":30123},{"type":"v1","addr":"172.21.15.196:6801","nonce":30123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":30123},{"type":"v1","addr":"172.21.15.196:6803","nonce":30123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":30123},{"type":"v1","addr":"172.21.15.196:6807","nonce":30123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":30123},{"type":"v1","addr":"172.21.15.196:6805","nonce":30123}]},"public_addr":"172.21.15.196:6801/30123","cluster_addr":"172.21.15.196:6803/30123","heartbeat_back_addr":"172.21.15.196:6807/30123","heartbeat_front_addr":"172.21.15.196:6805/30123","state":["exists","up"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":30124},{"type":"v1","addr":"172.21.15.196:6817","nonce":30124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":30124},{"type":"v1","addr":"172.21.15.196:6819","nonce":30124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":30124},{"type":"v1","addr":"172.21.15.196:6823","nonce":30124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":30124},{"type":"v1","addr":"172.21.15.196:6821","nonce":30124}]},"public_addr":"172.21.15.196:6817/30124","cluster_addr":"172.21.15.196:6819/30124","heartbeat_back_addr":"172.21.15.196:6823/30124","heartbeat_front_addr":"172.21.15.196:6821/30124","state":["exists","up"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":30125},{"type":"v1","addr":"172.21.15.196:6809","nonce":30125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":30125},{"type":"v1","addr":"172.21.15.196:6811","nonce":30125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":30125},{"type":"v1","addr":"172.21.15.196:6815","nonce":30125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":30125},{"type":"v1","addr":"172.21.15.196:6813","nonce":30125}]},"public_addr":"172.21.15.196:6809/30125","cluster_addr":"172.21.15.196:6811/30125","heartbeat_back_addr":"172.21.15.196:6815/30125","heartbeat_front_addr":"172.21.15.196:6813/30125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.305629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.358057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.524266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:35:51.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-08T19:35:51.854 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:35:52.126 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:35:52.128 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:35:52.139 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5646,"stamp":"2023-11-08T19:35:51.286710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2214,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771608+0000","last_change":"2023-11-08T16:38:25.379089+0000","last_active":"2023-11-08T17:36:11.771608+0000","last_peered":"2023-11-08T17:36:11.771608+0000","last_clean":"2023-11-08T17:36:11.771608+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T17:36:11.771608+0000","last_undegraded":"2023-11-08T17:36:11.771608+0000","last_fullsized":"2023-11-08T17:36:11.771608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.30399999999999999},"max":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.38300000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.441},"max":{"1min":0.65800000000000003,"5min":0.70299999999999996,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.48699999999999999},"max":{"1min":0.77600000000000002,"5min":0.80300000000000005,"15min":1.0389999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740572,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.61899999999999999,"5min":0.70199999999999996,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.66400000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.51600000000000001,"5min":0.46300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68600000000000005,"5min":0.74299999999999999,"15min":0.95299999999999996},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48699999999999999},"max":{"1min":0.69399999999999995,"5min":0.71399999999999997,"15min":0.92700000000000005},"last":0.73699999999999999}]}]},{"osd":1,"up_from":7,"seq":30064773272,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63600000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.442},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.91000000000000003},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.44},"max":{"1min":0.73399999999999999,"5min":0.82699999999999996,"15min":0.871},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58299999999999996,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.63600000000000001,"5min":0.80100000000000005,"15min":0.998},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:35:52.140 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:35:52.421 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:35:52.423 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:35:52.434 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5646,"stamp":"2023-11-08T19:35:51.286710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2214,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771608+0000","last_change":"2023-11-08T16:38:25.379089+0000","last_active":"2023-11-08T17:36:11.771608+0000","last_peered":"2023-11-08T17:36:11.771608+0000","last_clean":"2023-11-08T17:36:11.771608+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T17:36:11.771608+0000","last_undegraded":"2023-11-08T17:36:11.771608+0000","last_fullsized":"2023-11-08T17:36:11.771608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.30399999999999999},"max":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.38300000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.441},"max":{"1min":0.65800000000000003,"5min":0.70299999999999996,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.48699999999999999},"max":{"1min":0.77600000000000002,"5min":0.80300000000000005,"15min":1.0389999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740572,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.61899999999999999,"5min":0.70199999999999996,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.66400000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.51600000000000001,"5min":0.46300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68600000000000005,"5min":0.74299999999999999,"15min":0.95299999999999996},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48699999999999999},"max":{"1min":0.69399999999999995,"5min":0.71399999999999997,"15min":0.92700000000000005},"last":0.73699999999999999}]}]},{"osd":1,"up_from":7,"seq":30064773272,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63600000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.442},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.91000000000000003},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.44},"max":{"1min":0.73399999999999999,"5min":0.82699999999999996,"15min":0.871},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58299999999999996,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.63600000000000001,"5min":0.80100000000000005,"15min":0.998},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:35:52.435 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-08T19:35:52.436 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:35:52.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:52.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:52.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:52.609+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:52.628 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:52.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:52.705 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:35:52.708 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:35:52.722 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5646,"stamp":"2023-11-08T19:35:51.286710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2214,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771608+0000","last_change":"2023-11-08T16:38:25.379089+0000","last_active":"2023-11-08T17:36:11.771608+0000","last_peered":"2023-11-08T17:36:11.771608+0000","last_clean":"2023-11-08T17:36:11.771608+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T17:36:11.771608+0000","last_undegraded":"2023-11-08T17:36:11.771608+0000","last_fullsized":"2023-11-08T17:36:11.771608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740570,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.30399999999999999},"max":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.41499999999999998,"15min":0.38300000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:35:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.441},"max":{"1min":0.65800000000000003,"5min":0.70299999999999996,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64000000000000001,"15min":0.63700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.48699999999999999},"max":{"1min":0.77600000000000002,"5min":0.80300000000000005,"15min":1.0389999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740572,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"max":{"1min":0.61899999999999999,"5min":0.70199999999999996,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.57199999999999995},"min":{"1min":0.46800000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.66400000000000003,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:34:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.51600000000000001,"5min":0.46300000000000002,"15min":0.40300000000000002},"max":{"1min":0.68600000000000005,"5min":0.74299999999999999,"15min":0.95299999999999996},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48699999999999999},"max":{"1min":0.69399999999999995,"5min":0.71399999999999997,"15min":0.92700000000000005},"last":0.73699999999999999}]}]},{"osd":1,"up_from":7,"seq":30064773272,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.63600000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.442},"max":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.91000000000000003},"last":0.55400000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:34:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.626,"15min":0.58799999999999997},"min":{"1min":0.50800000000000001,"5min":0.47099999999999997,"15min":0.44},"max":{"1min":0.73399999999999999,"5min":0.82699999999999996,"15min":0.871},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58299999999999996,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.63600000000000001,"5min":0.80100000000000005,"15min":0.998},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:35:52.724 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-08T19:35:52.998 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:35:52.999 INFO:teuthology.orchestra.run.smithi196.stdout:{"epoch":158,"fsid":"c8f9847b-e808-4c51-aead-8d5627003eba","created":"2023-11-08T16:32:40.293224+0000","modified":"2023-11-08T17:36:46.776114+0000","last_up_change":"2023-11-08T16:32:48.264488+0000","last_in_change":"2023-11-08T16:32:41.070327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-11-08T16:32:48.330442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-11-08T16:32:48.682940+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-11-08T16:32:55.131120+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":154,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"adb5d5a9-dc78-44db-88ba-8e6dcb79b089","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":30123},{"type":"v1","addr":"172.21.15.196:6801","nonce":30123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":30123},{"type":"v1","addr":"172.21.15.196:6803","nonce":30123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":30123},{"type":"v1","addr":"172.21.15.196:6807","nonce":30123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":30123},{"type":"v1","addr":"172.21.15.196:6805","nonce":30123}]},"public_addr":"172.21.15.196:6801/30123","cluster_addr":"172.21.15.196:6803/30123","heartbeat_back_addr":"172.21.15.196:6807/30123","heartbeat_front_addr":"172.21.15.196:6805/30123","state":["exists","up"]},{"osd":1,"uuid":"f44c220f-6fb3-4482-8dd8-59b1829550bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":30124},{"type":"v1","addr":"172.21.15.196:6817","nonce":30124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":30124},{"type":"v1","addr":"172.21.15.196:6819","nonce":30124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":30124},{"type":"v1","addr":"172.21.15.196:6823","nonce":30124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":30124},{"type":"v1","addr":"172.21.15.196:6821","nonce":30124}]},"public_addr":"172.21.15.196:6817/30124","cluster_addr":"172.21.15.196:6819/30124","heartbeat_back_addr":"172.21.15.196:6823/30124","heartbeat_front_addr":"172.21.15.196:6821/30124","state":["exists","up"]},{"osd":2,"uuid":"6829c900-d6ff-4ed8-aebf-b6d0538176ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":30125},{"type":"v1","addr":"172.21.15.196:6809","nonce":30125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":30125},{"type":"v1","addr":"172.21.15.196:6811","nonce":30125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":30125},{"type":"v1","addr":"172.21.15.196:6815","nonce":30125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":30125},{"type":"v1","addr":"172.21.15.196:6813","nonce":30125}]},"public_addr":"172.21.15.196:6809/30125","cluster_addr":"172.21.15.196:6811/30125","heartbeat_back_addr":"172.21.15.196:6815/30125","heartbeat_front_addr":"172.21.15.196:6813/30125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.305629+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.358057+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-11-08T16:32:46.524266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-08T19:35:53.529 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:53.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:53.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:53.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:53.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:53.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:54.013 INFO:tasks.ceph:Scrubbing osd.0 2023-11-08T19:35:54.014 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:35:54.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:54.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:54.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:54.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:54.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:54.689+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:55.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:55.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:55.579 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:55.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:55.728 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:55.725+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:56.537 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:56.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:56.570 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:56.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:56.763 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:56.761+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:57.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:57.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:57.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:57.569+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:57.740 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:57.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:58.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:58.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:58.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:58.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:58.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:58.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:59.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:35:59.489+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:35:59.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:35:59.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:35:59.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:35:59.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:00.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:00.477+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:00.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:00.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:00.700 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:00.697+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:01.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:01.521+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:01.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:01.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:01.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:01.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:02.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:02.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:02.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:02.589+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:02.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:02.685+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:03.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:03.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:03.574 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:03.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:03.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:03.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:04.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:04.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:04.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:04.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:04.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:04.765+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:05.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:05.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:05.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:05.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:05.741 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:05.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:06.476 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:06.473+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:06.566 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:06.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:06.723 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:06.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:07.462 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:07.457+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:07.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:07.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:07.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:07.721+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:08.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:08.469+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:08.602 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:08.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:08.742 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:08.737+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:09.506 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:09.505+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:09.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:09.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:09.743 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:09.741+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:10.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:10.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:10.541 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:10.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:10.784 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:10.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:11.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:11.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:11.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:11.561+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:11.819 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:11.817+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:12.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:12.537+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:12.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:12.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:12.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:12.849+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:13.503 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:13.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:13.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:13.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:13.901 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:13.897+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:14.552 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:14.549+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:14.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:14.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:14.935 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:14.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:15.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:15.513+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:15.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:15.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:15.948 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:15.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:16.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:16.501+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:16.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:16.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:16.962 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:16.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:17.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:17.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:17.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:17.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:17.987 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:17.985+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:18.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:18.497+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:18.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:18.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:18.993 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:18.989+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:19.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:19.525+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:19.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:19.525+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:20.041 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:20.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:20.497 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:20.493+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:20.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:20.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:21.032 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:21.029+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:21.510 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:21.509+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:21.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:21.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:22.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:22.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:22.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:22.481+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:22.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:22.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:23.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:23.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:23.480 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:23.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:23.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:23.517+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:24.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:24.069+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:24.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:24.485+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:24.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:24.509+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:25.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:25.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:25.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:25.505+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:25.560 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:25.557+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:26.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:26.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:26.555 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:26.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:26.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:26.557+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:27.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:27.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:27.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:27.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:27.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:27.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:28.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:28.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:28.528 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:28.524+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:28.589 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:28.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:29.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:29.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:29.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:29.556+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:29.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:29.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:30.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:30.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:30.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:30.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:30.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:30.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:31.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:31.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:31.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:31.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:31.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:31.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:32.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:32.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:32.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:32.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:32.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:32.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:33.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:33.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:33.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:33.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:33.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:33.616+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:34.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:34.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:34.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:34.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:34.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:34.616+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:35.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:35.084+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:35.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:35.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:35.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:35.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:36.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:36.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:36.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:36.536+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:36.603 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:36.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:37.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:37.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:37.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:37.540+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:37.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:37.568+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:38.043 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:38.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:38.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:38.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:38.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:38.600+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:39.063 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:39.060+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:39.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:39.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:39.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:39.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:40.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:40.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:40.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:40.516+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:40.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:40.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:41.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:41.072+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:41.496 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:41.492+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:41.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:41.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:42.071 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:42.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:42.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:42.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:42.535 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:42.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:43.112 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:43.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:43.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:43.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:43.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:43.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:44.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:44.100+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:44.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:44.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:44.472 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:44.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:45.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:45.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:45.424 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:45.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:45.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:45.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:46.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:46.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:46.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:46.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:46.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:46.456+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:47.113 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:47.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:47.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:47.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:47.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:47.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:48.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:48.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:48.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:48.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:48.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:48.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:49.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:49.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:49.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:49.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:49.493 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:49.488+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:50.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:50.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:50.473 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:50.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:50.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:50.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:51.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:51.172+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:51.440 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:51.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:51.504 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:51.500+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:52.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:52.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:52.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:52.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:52.512 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:52.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:53.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:53.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:53.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:53.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:53.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:53.504+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:54.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:54.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:54.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:54.332+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:54.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:54.512+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:55.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:55.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:55.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:55.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:55.524 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:55.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:56.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:56.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:56.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:56.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:56.554 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:56.548+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:57.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:57.148+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:57.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:57.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:57.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:57.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:58.196 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:58.192+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:58.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:58.420+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:58.614 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:58.608+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:59.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:36:59.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:36:59.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:36:59.456+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:36:59.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:36:59.652+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:00.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:00.136+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:00.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:00.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:00.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:00.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:01.115 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:01.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:01.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:01.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:01.616 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:01.612+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:02.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:02.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:02.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:02.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:02.634 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:02.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:03.040 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:03.036+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:03.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:03.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:03.675 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:03.672+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:04.030 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:04.028+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:04.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:04.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:04.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:04.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:04.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:04.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:05.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:05.576+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:05.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:05.704+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:06.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:05.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:06.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:06.616+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:06.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:06.716+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:07.007 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:07.004+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:07.584 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:07.580+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:07.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:07.688+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:08.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:08.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:08.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:08.532+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:08.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:08.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:09.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:09.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:09.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:09.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:09.706 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:09.704+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:10.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:10.056+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:10.556 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:10.552+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:10.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:10.684+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:11.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:11.080+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:11.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:11.528+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:11.712 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:11.708+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:12.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:12.076+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:12.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:12.540+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:12.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:12.724+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:13.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:13.112+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:13.517 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:13.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:13.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:13.755+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:14.098 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:14.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:14.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:14.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:14.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:14.739+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:15.072 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:15.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:15.573 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:15.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:15.708 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:15.703+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:16.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:16.031+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:16.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:16.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:16.757 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:16.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:17.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:17.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:17.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:17.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:17.739 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:17.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:18.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:18.079+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:18.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:18.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:18.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:18.787+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:19.123 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:19.119+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:19.538 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:19.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:19.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:19.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:20.139 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:20.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:20.535 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:20.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:20.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:20.763+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:21.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:21.127+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:21.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:21.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:21.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:21.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:22.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:22.127+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:22.585 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:22.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:22.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:22.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:23.127 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:23.123+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:23.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:23.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:23.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:23.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:24.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:24.075+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:24.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:24.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:24.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:24.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:25.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:25.079+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:25.540 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:25.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:25.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:25.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:26.079 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:26.075+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:26.552 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:26.547+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:26.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:26.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:27.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:27.111+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:27.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:27.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:27.748 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:27.743+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:28.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:28.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:28.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:28.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:28.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:28.695+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:29.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:29.119+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:29.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:29.571+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:29.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:29.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:30.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:30.103+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:30.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:30.575+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:30.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:30.767+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:31.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:31.155+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:31.549 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:31.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:31.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:31.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:32.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:32.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:32.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:32.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:32.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:32.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:33.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:33.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:33.470 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:33.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:33.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:33.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:34.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:34.111+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:34.426 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:34.419+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:34.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:34.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:35.133 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:35.127+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:35.422 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:35.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:35.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:35.751+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:36.148 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:36.143+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:36.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:36.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:36.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:36.795+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:37.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:37.099+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:37.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:37.371+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:37.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:37.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:38.141 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:38.135+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:38.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:38.363+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:38.820 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:38.815+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:39.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:39.163+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:39.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:39.335+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:39.839 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:39.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:40.126 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:40.119+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:40.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:40.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:40.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:40.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:41.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:41.103+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:41.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:41.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:41.914 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:41.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:42.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:42.071+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:42.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:42.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:42.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:42.887+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:43.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:43.115+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:43.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:43.359+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:43.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:43.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:44.088 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:44.083+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:44.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:44.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:44.846 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:44.839+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:45.103 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:45.099+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:45.398 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:45.391+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:45.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:45.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:46.057 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:46.051+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:46.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:46.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:46.851 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:46.847+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:47.020 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:47.015+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:47.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:47.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:47.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:47.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:48.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:48.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:48.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:48.459+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:48.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:48.863+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:49.089 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:49.083+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:49.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:49.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:49.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:49.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:50.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:50.063+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:50.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:50.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:50.824 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:50.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:51.031 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:51.027+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:51.492 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:51.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:51.838 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:51.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:52.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:51.995+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:52.490 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:52.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:52.825 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:52.819+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:52.954 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:52.951+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:53.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:53.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:53.798 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:53.791+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:53.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:53.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:54.038 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-08T19:37:54.040 INFO:tasks.ceph:Scrubbing osd.1 2023-11-08T19:37:54.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:37:54.478 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:54.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:54.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:54.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:54.952 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:54.947+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:55.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:55.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:55.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:55.799+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:55.994 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:55.987+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:56.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:56.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:56.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:56.759+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:57.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:57.023+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:57.391 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:57.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:57.723 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:57.719+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:57.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:57.979+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:58.381 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:58.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:58.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:58.711+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:58.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:58.959+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:59.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:37:59.375+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:37:59.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:37:59.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:37:59.940 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:37:59.934+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:00.372 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:00.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:00.793 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:00.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:00.983 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:00.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:01.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:01.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:01.772 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:01.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:02.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:02.014+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:02.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:02.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:02.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:02.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:03.015 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:03.010+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:03.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:03.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:03.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:03.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:04.038 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:04.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:04.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:04.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:04.804 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:04.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:05.039 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:05.034+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:05.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:05.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:05.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:05.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:06.060 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:06.054+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:06.466 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:06.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:06.823 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:06.818+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:07.096 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:07.090+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:07.481 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:07.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:07.840 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:07.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:08.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:08.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:08.438 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:08.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:08.834 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:08.830+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:09.075 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:09.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:09.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:09.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:09.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:09.858+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:10.069 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:10.062+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:10.431 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:10.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:10.842 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:10.834+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:11.050 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:11.042+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:11.467 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:11.462+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:11.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:11.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:12.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:12.018+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:12.474 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:12.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:12.811 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:12.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:12.985 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:12.978+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:13.520 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:13.514+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:13.810 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:13.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:14.004 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:13.998+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:14.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:14.522+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:14.769 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:14.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:14.973 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:14.966+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:15.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:15.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:15.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:15.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:16.023 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:16.018+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:16.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:16.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:16.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:16.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:17.009 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:17.002+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:17.634 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:17.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:17.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:17.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:17.988 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:17.982+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:18.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:18.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:18.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:18.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:19.035 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:19.030+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:19.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:19.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:19.697 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:19.690+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:20.077 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:20.070+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:20.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:20.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:20.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:20.706+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:21.055 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:21.050+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:21.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:21.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:21.680 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:21.674+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:22.065 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:22.058+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:22.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:22.594+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:22.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:22.666+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:23.083 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:23.078+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:23.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:23.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:23.665 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:23.658+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:24.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:24.086+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:24.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:24.542+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:24.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:24.626+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:25.104 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:25.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:25.544 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:25.538+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:25.649 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:25.642+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:26.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:26.110+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:26.580 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:26.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:26.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:26.694+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:27.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:27.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:27.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:27.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:27.682 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:27.678+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:28.085 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:28.078+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:28.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:28.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:28.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:28.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:29.099 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:29.094+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:29.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:29.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:29.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:29.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:30.125 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:30.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:30.604 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:30.598+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:30.730 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:30.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:31.166 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:31.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:31.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:31.638+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:31.732 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:31.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:32.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:32.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:32.659 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:32.654+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:32.756 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:32.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:33.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:33.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:33.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:33.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:33.773 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:33.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:34.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:34.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:34.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:34.710+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:34.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:34.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:35.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:35.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:35.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:35.750+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:35.828 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:35.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:36.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:36.150+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:36.770 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:36.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:36.814 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:36.806+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:37.163 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:37.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:37.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:37.786+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:37.822 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:37.814+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:38.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:38.178+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:38.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:38.742+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:38.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:38.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:39.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:39.222+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:39.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:39.722+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:39.827 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:39.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:40.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:40.250+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:40.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:40.714+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:40.791 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:40.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:41.279 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:41.274+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:41.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:41.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:41.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:41.758+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:42.256 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:42.250+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:42.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:42.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:42.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:42.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:43.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:43.214+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:43.760 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:43.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:43.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:43.778+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:44.197 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:44.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:44.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:44.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:44.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:44.746+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:45.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:45.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:45.744 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:45.738+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:45.768 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:45.762+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:46.280 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:46.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:46.748 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:46.741+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:46.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:46.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:47.264 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:47.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:47.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:47.721+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:47.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:47.725+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:48.307 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:48.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:48.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:48.729+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:48.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:48.761+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:49.281 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:49.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:49.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:49.713+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:49.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:49.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:50.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:50.281+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:50.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:50.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:50.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:50.745+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:51.278 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:51.269+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:51.651 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:51.645+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:51.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:51.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:52.295 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:52.289+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:52.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:52.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:52.787 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:52.781+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:53.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:53.301+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:53.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:53.661+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:53.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:53.773+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:54.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:54.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:54.647 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:54.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:54.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:54.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:55.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:55.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:55.666 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:55.657+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:55.784 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:55.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:56.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:56.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:56.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:56.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:56.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:56.797+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:57.334 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:57.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:57.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:57.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:57.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:57.769+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:58.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:58.317+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:58.604 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:58.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:58.726 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:58.721+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:38:59.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:38:59.357+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:59.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:38:59.637+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:38:59.746 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:38:59.741+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:00.370 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:00.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:00.658 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:00.653+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:00.722 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:00.717+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:01.339 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:01.337+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:01.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:01.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:01.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:01.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:02.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:02.321+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:02.642 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:02.641+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:02.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:02.681+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:03.332 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:03.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:03.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:03.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:03.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:03.669+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:04.327 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:04.325+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:04.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:04.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:04.624 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:04.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:05.346 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:05.341+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:05.556 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:05.553+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:05.582 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:05.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:06.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:06.313+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:06.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:06.533+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:06.605 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:06.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:07.348 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:07.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:07.588 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:07.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:07.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:07.645+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:08.365 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:08.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:08.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:08.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:08.606 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:08.601+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:09.382 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:09.377+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:09.590 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:09.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:09.622 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:09.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:10.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:10.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:10.617 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:10.613+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:10.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:10.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:11.362 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:11.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:11.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:11.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:11.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:11.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:12.355 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:12.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:12.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:12.609+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:12.656 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:12.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:13.368 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:13.365+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:13.623 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:13.621+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:13.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:13.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:14.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:14.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:14.613 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:14.609+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:14.620 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:14.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:15.438 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:15.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:15.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:15.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:15.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:15.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:16.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:16.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:16.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:16.541+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:16.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:16.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:17.453 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:17.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:17.577 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:17.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:17.599 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:17.597+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:18.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:18.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:18.576 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:18.573+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:18.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:18.605+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:19.512 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:19.509+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:19.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:19.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:19.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:19.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:20.493 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:20.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:20.533 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:20.529+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:20.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:20.585+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:21.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:21.485+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:21.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:21.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:21.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:21.577+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:22.446 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:22.445+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:22.536 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:22.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:22.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:22.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:23.416 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:23.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:23.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:23.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:23.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:23.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:24.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:24.461+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:24.499 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:24.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:24.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:24.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:25.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:25.421+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:25.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:25.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:25.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:25.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:26.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:26.401+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:26.505 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:26.501+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:26.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:26.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:27.387 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:27.385+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:27.543 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:27.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:27.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:27.569+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:28.367 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:28.365+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:28.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:28.557+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:28.562 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:28.561+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:29.382 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:29.377+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:29.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:29.529+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:29.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:29.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:30.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:30.417+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:30.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:30.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:30.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:30.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:31.417 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:31.413+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:31.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:31.545+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:31.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:31.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:32.454 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:32.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:32.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:32.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:32.609 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:32.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:33.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:33.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:33.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:33.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:33.621 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:33.616+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:34.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:34.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:34.475 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:34.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:34.651 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:34.648+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:35.440 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:35.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:35.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:35.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:35.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:35.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:36.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:36.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:36.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:36.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:36.643 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:36.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:37.449 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:37.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:37.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:37.584+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:37.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:37.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:38.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:38.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:38.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:38.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:38.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:38.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:39.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:39.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:39.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:39.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:39.662 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:39.656+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:40.456 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:40.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:40.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:40.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:40.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:40.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:41.430 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:41.424+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:41.606 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:41.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:41.647 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:41.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:42.432 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:42.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:42.638 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:42.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:42.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:42.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:43.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:43.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:43.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:43.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:43.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:43.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:44.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:44.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:44.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:44.656+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:44.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:44.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:45.371 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:45.368+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:45.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:45.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:45.714 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:45.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:46.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:46.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:46.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:46.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:46.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:46.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:47.420 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:47.416+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:47.658 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:47.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:47.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:47.660+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:48.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:48.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:48.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:48.620+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:48.695 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:48.692+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:49.423 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:49.420+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:49.632 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:49.628+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:49.734 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:49.728+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:50.441 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:50.436+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:50.592 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:50.588+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:50.769 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:50.764+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:51.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:51.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:51.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:51.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:51.788 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:51.784+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:52.407 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:52.404+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:52.529 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:52.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:52.792 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:52.788+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:53.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:53.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:53.530 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:53.524+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:53.749 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:53.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:54.063 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-11-08T19:39:54.064 INFO:tasks.ceph:Scrubbing osd.2 2023-11-08T19:39:54.065 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-08T19:39:54.207 INFO:teuthology.orchestra.run.smithi196.stdout:{ 2023-11-08T19:39:54.208 INFO:teuthology.orchestra.run.smithi196.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-08T19:39:54.208 INFO:teuthology.orchestra.run.smithi196.stdout:} 2023-11-08T19:39:54.220 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-08T19:39:54.400 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:54.396+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:54.509 INFO:teuthology.orchestra.run.smithi196.stderr:instructed osd(s) 2 to deep-scrub 2023-11-08T19:39:54.519 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:39:54.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:54.544+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:54.730 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:54.724+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:54.786 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:39:54.788 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:39:54.803 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5767,"stamp":"2023-11-08T19:39:53.353331+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003326"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2214,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771608+0000","last_change":"2023-11-08T16:38:25.379089+0000","last_active":"2023-11-08T17:36:11.771608+0000","last_peered":"2023-11-08T17:36:11.771608+0000","last_clean":"2023-11-08T17:36:11.771608+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T17:36:11.771608+0000","last_undegraded":"2023-11-08T17:36:11.771608+0000","last_fullsized":"2023-11-08T17:36:11.771608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740618,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.42799999999999999,"5min":0.38,"15min":0.30399999999999999},"max":{"1min":0.628,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.47399999999999998,"5min":0.41999999999999998,"15min":0.38300000000000001},"max":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.46999999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.441},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.504},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.48699999999999999},"max":{"1min":0.71499999999999997,"5min":0.77600000000000002,"15min":1.0389999999999999},"last":0.56200000000000006}]}]},{"osd":0,"up_from":8,"seq":34359740620,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.39300000000000002},"max":{"1min":0.67700000000000005,"5min":0.69999999999999996,"15min":0.71999999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.66600000000000004,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.40300000000000002},"max":{"1min":0.65700000000000003,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.52800000000000002,"5min":0.48999999999999999,"15min":0.48699999999999999},"max":{"1min":0.71099999999999997,"5min":0.73699999999999999,"15min":0.82599999999999996},"last":0.58999999999999997}]}]},{"osd":1,"up_from":7,"seq":30064773321,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.42099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.67900000000000005,"5min":0.69699999999999995,"15min":0.71099999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.47399999999999998,"5min":0.44700000000000001,"15min":0.442},"max":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.499,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.871},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.67600000000000005,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:39:54.808 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.808 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.809 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.809 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.809 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.810 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.810 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.811 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.811 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.811 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.812 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.812 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.812 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:39:54.813 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:39:55.435 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:55.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:55.554 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:55.548+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:55.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:55.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:56.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:56.428+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:56.590 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:56.584+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:56.724 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:56.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:57.474 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:57.468+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:57.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:57.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:57.686 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:57.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:58.513 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:58.508+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:58.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:58.592+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:58.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:58.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:59.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:39:59.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:39:59.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:39:59.556+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:39:59.692 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:39:59.688+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:00.498 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:00.492+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:00.570 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:00.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:00.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:00.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:01.451 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:01.448+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:01.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:01.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:01.668 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:01.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:02.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:02.484+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:02.600 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:02.596+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:02.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:02.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:03.444 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:03.440+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:03.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:03.608+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:03.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:03.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:04.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:04.480+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:04.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:04.604+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:04.753 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:04.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:05.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:05.476+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:05.617 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:05.612+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:05.709 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:05.704+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:06.478 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:06.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:06.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:06.564+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:06.719 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:06.716+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:07.438 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:07.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:07.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:07.536+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:07.747 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:07.744+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:08.470 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:08.464+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:08.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:08.512+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:08.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:08.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:09.457 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:09.452+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:09.493 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:09.488+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:09.704 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:09.700+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:10.448 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:10.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:10.450 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:10.444+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:10.684 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:10.680+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:11.415 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:11.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:11.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:11.472+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:11.726 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:11.720+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:12.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:12.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:12.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:12.432+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:12.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:12.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:13.390 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:13.384+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:13.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:13.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:13.718 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:13.712+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:14.403 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:14.400+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:14.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:14.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:14.676 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:14.672+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:14.814 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:40:15.109 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:40:15.112 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:40:15.122 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5777,"stamp":"2023-11-08T19:40:13.358765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740622,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:39:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"max":{"1min":0.70099999999999996,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.59299999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:39:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.441},"max":{"1min":0.66600000000000004,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":1.0389999999999999},"last":0.71199999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740624,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40300000000000002},"max":{"1min":0.72799999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56499999999999995}]}]},{"osd":1,"up_from":7,"seq":30064773325,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58399999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"last":0.499},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67200000000000004,"5min":0.73199999999999998,"15min":0.80300000000000005},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:40:15.124 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.124 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.125 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.125 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.126 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.126 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.126 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.127 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.127 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.127 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.128 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.128 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.129 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:15.129 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:40:15.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:15.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:15.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:15.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:15.698 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:15.696+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:16.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:16.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:16.469 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:16.464+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:16.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:16.656+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:17.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:17.388+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:17.472 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:17.468+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:17.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:17.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:18.433 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:18.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:18.437 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:18.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:18.689 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:18.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:19.450 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:19.443+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:19.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:19.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:19.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:19.639+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:20.439 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:20.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:20.460 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:20.455+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:20.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:20.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:21.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:21.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:21.448 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:21.443+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:21.622 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:21.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:22.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:22.383+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:22.484 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:22.479+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:22.655 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:22.651+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:23.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:23.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:23.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:23.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:23.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:23.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:24.362 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:24.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:24.501 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:24.495+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:24.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:24.683+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:25.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:25.319+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:25.510 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:25.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:25.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:25.675+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:26.311 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:26.307+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:26.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:26.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:26.677 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:26.671+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:27.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:27.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:27.447 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:27.443+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:27.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:27.627+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:28.349 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:28.343+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:28.439 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:28.435+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:28.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:28.599+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:29.343 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:29.339+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:29.414 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:29.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:29.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:29.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:30.336 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:30.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:30.425 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:30.419+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:30.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:30.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:31.337 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:31.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:31.398 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:31.391+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:31.567 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:31.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:32.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:32.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:32.412 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:32.407+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:32.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:32.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:33.292 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:33.287+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:33.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:33.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:33.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:33.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:34.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:34.263+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:34.466 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:34.459+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:34.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:34.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:35.130 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:40:35.223 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:35.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:35.412 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:40:35.414 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:40:35.429 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5788,"stamp":"2023-11-08T19:40:35.364665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003208"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740627,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,2,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:39:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.41999999999999998,"15min":0.40400000000000003},"max":{"1min":0.70099999999999996,"5min":0.72499999999999998,"15min":0.97099999999999997},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:39:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.441},"max":{"1min":0.66600000000000004,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.71399999999999997,"5min":0.77600000000000002,"15min":1.0389999999999999},"last":0.61799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740629,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"last":0.439},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.52800000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40300000000000002},"max":{"1min":0.72799999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.623}]}]},{"osd":1,"up_from":7,"seq":30064773329,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58399999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.62}]},{"osd":2,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67200000000000004,"5min":0.73199999999999998,"15min":0.80300000000000005},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:40:35.431 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.431 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.431 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.432 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.432 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.433 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.433 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.433 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.434 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.434 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.435 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.435 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.435 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:35.436 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:40:35.489 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:35.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:35.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:35.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:36.191 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:36.187+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:36.481 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:36.475+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:36.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:36.547+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:37.218 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:37.215+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:37.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:37.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:37.516 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:37.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:38.263 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:38.259+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:38.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:38.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:38.537 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:38.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:39.229 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:39.223+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:39.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:39.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:39.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:39.543+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:40.206 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:40.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:40.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:40.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:40.540 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:40.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:41.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:41.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:41.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:41.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:41.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:41.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:42.200 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:42.195+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:42.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:42.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:42.514 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:42.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:43.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:43.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:43.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:43.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:43.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:43.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:44.211 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:44.207+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:44.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:44.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:44.539 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:44.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:45.176 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:45.171+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:45.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:45.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:45.583 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:45.579+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:46.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:46.203+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:46.542 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:46.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:46.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:46.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:47.244 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:47.239+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:47.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:47.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:47.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:47.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:48.226 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:48.219+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:48.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:48.463+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:48.636 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:48.631+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:49.179 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:49.175+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:49.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:49.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:49.607 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:49.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:50.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:50.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:50.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:50.503+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:50.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:50.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:51.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:51.195+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:51.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:51.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:51.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:51.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:52.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:52.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:52.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:52.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:52.628 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:52.623+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:53.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:53.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:53.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:53.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:53.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:53.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:54.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:54.199+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:54.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:54.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:54.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:54.611+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:55.240 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:55.235+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:55.437 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:40:55.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:55.563+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:55.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:55.583+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:55.723 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:40:55.725 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:40:55.736 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5798,"stamp":"2023-11-08T19:40:55.370381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,2,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740631,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,2,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.624},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.74199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740633,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.65400000000000003,"5min":0.69999999999999996,"15min":0.71999999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.47799999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.69699999999999995,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.40300000000000002},"max":{"1min":0.72799999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.48699999999999999},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59899999999999998}]}]},{"osd":1,"up_from":7,"seq":30064773333,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58399999999999996,"5min":0.69699999999999995,"15min":0.71099999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:39:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.47399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60199999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.67200000000000004,"5min":0.73199999999999998,"15min":0.80300000000000005},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:40:55.738 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.739 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.740 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.740 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.741 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.741 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.741 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.742 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.742 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.743 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.743 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.744 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.744 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:40:55.744 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:40:56.250 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:56.243+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:56.569 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:56.563+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:56.609 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:56.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:57.236 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:57.231+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:57.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:57.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:57.632 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:57.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:58.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:58.279+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:58.587 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:58.583+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:58.589 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:58.583+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:59.333 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:40:59.327+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:40:59.542 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:40:59.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:40:59.592 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:40:59.587+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:00.353 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:00.347+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:00.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:00.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:00.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:00.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:01.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:01.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:01.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:01.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:01.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:01.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:02.304 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:02.299+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:02.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:02.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:02.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:02.595+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:03.316 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:03.311+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:03.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:03.463+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:03.618 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:03.615+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:04.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:04.271+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:04.508 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:04.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:04.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:04.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:05.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:05.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:05.483 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:05.478+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:05.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:05.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:06.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:06.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:06.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:06.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:06.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:06.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:07.289 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:07.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:07.480 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:07.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:07.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:07.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:08.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:08.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:08.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:08.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:08.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:08.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:09.271 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:09.266+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:09.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:09.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:09.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:09.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:10.318 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:10.310+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:10.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:10.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:10.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:10.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:11.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:11.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:11.467 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:11.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:11.662 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:11.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:12.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:12.290+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:12.518 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:12.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:12.620 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:12.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:13.290 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:13.282+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:13.531 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:13.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:13.571 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:13.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:14.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:14.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:14.515 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:14.510+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:14.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:14.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:15.278 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:15.270+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:15.469 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:15.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:15.616 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:15.610+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:15.745 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:41:16.031 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:41:16.034 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:41:16.044 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5808,"stamp":"2023-11-08T19:41:15.375857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,2,2,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003203"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740635,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,2,2,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.70699999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740637,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.71999999999999997,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.40300000000000002},"max":{"1min":0.67300000000000004,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.68200000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58499999999999996}]}]},{"osd":1,"up_from":7,"seq":30064773337,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.503},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.52200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.53300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:41:16.046 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.047 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.047 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.047 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.048 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.049 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.049 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.049 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.050 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.050 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.051 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.051 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.051 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:16.052 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:41:16.242 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:16.234+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:16.521 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:16.514+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:16.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:16.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:17.201 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:17.194+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:17.568 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:17.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:17.626 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:17.618+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:18.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:18.182+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:18.549 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:18.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:18.641 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:18.634+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:19.140 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:19.134+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:19.548 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:19.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:19.629 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:19.622+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:20.099 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:20.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:20.543 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:20.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:20.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:20.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:21.120 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:21.114+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:21.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:21.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:21.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:21.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:22.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:22.138+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:22.545 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:22.538+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:22.675 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:22.670+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:23.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:23.126+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:23.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:23.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:23.691 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:23.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:24.101 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:24.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:24.502 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:24.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:24.685 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:24.678+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:25.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:25.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:25.492 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:25.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:25.665 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:25.658+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:26.021 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:26.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:26.527 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:26.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:26.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:26.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:27.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:27.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:27.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:27.562+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:27.694 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:27.686+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:28.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:28.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:28.550 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:28.542+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:28.648 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:28.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:29.027 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:29.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:29.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:29.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:29.649 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:29.642+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:30.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:30.022+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:30.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:30.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:30.614 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:30.606+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:31.051 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:31.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:31.499 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:31.494+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:31.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:31.570+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:32.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:32.094+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:32.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:32.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:32.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:32.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:33.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:33.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:33.495 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:33.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:33.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:33.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:34.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:34.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:34.468 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:34.462+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:34.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:34.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:35.079 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:35.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:35.491 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:35.486+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:35.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:35.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:36.053 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:41:36.090 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:36.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:36.335 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:41:36.338 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:41:36.348 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5818,"stamp":"2023-11-08T19:41:35.381267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003219"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1801,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772185+0000","last_change":"2023-11-08T16:38:25.398629+0000","last_active":"2023-11-08T17:36:11.772185+0000","last_peered":"2023-11-08T17:36:11.772185+0000","last_clean":"2023-11-08T17:36:11.772185+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T17:36:11.772185+0000","last_undegraded":"2023-11-08T17:36:11.772185+0000","last_fullsized":"2023-11-08T17:36:11.772185+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740639,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.51500000000000001,"15min":0.51600000000000001},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.64800000000000002,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.40400000000000003},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.73499999999999999,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.53900000000000003,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740641,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71999999999999997},"last":0.432},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.71999999999999997,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.40300000000000002},"max":{"1min":0.67300000000000004,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.68200000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.60899999999999999}]}]},{"osd":1,"up_from":7,"seq":30064773341,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44400000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.52200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.55300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:41:36.350 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.351 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.351 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.351 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.352 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.352 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.353 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.353 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.353 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.354 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.354 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.354 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.355 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:41:36.355 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:41:36.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:36.530+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:36.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:36.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:36.635 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:41:36.645 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:41:36.923 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:41:36.938 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:41:37.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:37.054+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:37.214 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:41:37.224 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:41:37.506 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:41:37.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:41:37.530 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:37.522+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:37.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:37.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:37.797 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:41:37.811 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:41:38.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:38.030+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:38.075 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:41:38.085 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:41:38.357 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:41:38.367 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:41:38.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:38.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:38.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:38.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:38.643 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:41:38.654 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:41:38.930 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:41:38.940 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:41:39.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:39.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:39.220 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:41:39.230 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:41:39.516 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:41:39.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:39.514+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:39.526 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:41:39.534 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:39.526+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:39.799 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:41:39.813 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:41:40.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:40.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:40.138 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:41:40.149 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:41:40.496 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:40.490+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:40.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:40.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:41.109 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:41.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:41.461 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:41.454+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:41.536 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:41.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:42.082 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:42.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:42.488 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:42.482+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:42.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:42.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:43.049 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:43.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:43.479 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:43.474+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:43.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:43.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:44.044 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:44.038+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:44.465 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:44.458+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:44.538 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:44.530+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:45.048 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:45.042+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:45.509 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:45.502+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:45.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:45.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:46.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:46.074+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:46.499 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:46.494+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:46.523 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:46.518+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:47.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:47.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:47.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:47.542+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:47.559 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:47.554+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:48.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:48.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:48.586 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:48.578+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:48.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:48.586+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:49.076 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:49.070+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:49.621 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:49.614+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:49.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:49.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:50.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:50.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:50.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:50.618+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:50.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:50.630+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:51.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:51.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:51.602 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:51.593+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:51.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:51.617+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:52.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:52.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:52.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:52.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:52.608 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:52.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:53.065 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:53.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:53.585 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:53.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:53.619 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:53.613+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:54.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:54.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:54.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:54.585+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:54.634 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:54.625+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:55.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:55.057+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:55.605 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:55.597+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:55.660 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:55.653+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:56.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:56.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:56.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:56.593+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:56.688 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:56.681+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:57.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:57.113+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:57.641 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:57.633+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:57.716 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:57.709+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:58.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:58.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:58.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:58.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:58.725 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:58.717+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:59.190 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:41:59.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:41:59.673 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:41:59.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:41:59.708 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:41:59.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:00.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:42:00.225 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:00.217+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:00.434 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:42:00.436 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:42:00.446 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5830,"stamp":"2023-11-08T19:41:59.387608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,5,514],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003165"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1821,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:41:57.638802+0000","last_change":"2023-11-08T19:41:57.639848+0000","last_active":"2023-11-08T19:41:57.638802+0000","last_peered":"2023-11-08T19:41:57.638802+0000","last_clean":"2023-11-08T19:41:57.638802+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:41:57.638802+0000","last_undegraded":"2023-11-08T19:41:57.638802+0000","last_fullsized":"2023-11-08T19:41:57.638802+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740644,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,5,2],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.67900000000000005,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.72799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.66500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740646,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.71999999999999997},"last":0.621},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.56399999999999995},"min":{"1min":0.47499999999999998,"5min":0.437,"15min":0.42799999999999999},"max":{"1min":0.71999999999999997,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.66100000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:41:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.40300000000000002},"max":{"1min":0.67300000000000004,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.68200000000000005,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59299999999999997}]}]},{"osd":1,"up_from":7,"seq":30064773346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.52200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.51300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:42:00.448 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.448 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.449 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.449 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.450 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.450 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.450 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.451 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.451 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.451 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.452 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.452 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.453 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:00.453 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:42:00.670 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:00.661+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:00.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:00.665+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:01.268 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:01.261+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:01.705 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:01.701+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:01.713 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:01.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:02.297 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:02.289+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:02.685 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:02.677+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:02.752 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:02.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:03.346 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:03.345+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:03.652 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:03.649+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:03.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:03.745+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:04.386 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:04.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:04.693 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:04.689+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:04.750 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:04.749+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:05.390 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:05.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:05.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:05.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:05.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:05.777+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:06.382 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:06.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:06.786 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:06.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:06.786 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:06.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:07.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:07.381+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:07.783 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:07.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:07.827 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:07.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:08.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:08.429+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:08.766 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:08.765+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:08.854 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:08.853+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:09.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:09.389+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:09.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:09.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:09.829 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:09.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:10.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:10.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:10.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:10.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:10.789 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:10.785+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:11.375 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:11.373+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:11.774 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:11.773+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:11.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:11.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:12.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:12.397+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:12.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:12.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:12.785 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:12.781+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:13.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:13.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:13.796 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:13.793+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:13.828 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:13.825+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:14.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:14.417+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:14.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:14.757+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:14.845 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:14.841+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:15.395 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:15.393+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:15.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:15.801+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:15.874 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:15.869+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:16.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:16.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:16.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:16.769+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:16.878 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:16.873+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:17.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:17.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:17.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:17.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:17.922 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:17.917+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:18.387 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:18.385+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:18.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:18.733+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:18.913 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:18.909+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:19.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:19.425+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:19.785 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:19.781+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:19.959 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:19.957+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:20.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:20.405+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:20.454 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:42:20.738 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:42:20.741 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:42:20.742 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:20.737+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:20.755 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5840,"stamp":"2023-11-08T19:42:19.393018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003323"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1837,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:42:12.778274+0000","last_change":"2023-11-08T19:42:12.779373+0000","last_active":"2023-11-08T19:42:12.778274+0000","last_peered":"2023-11-08T19:42:12.778274+0000","last_clean":"2023-11-08T19:42:12.778274+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:42:12.778274+0000","last_undegraded":"2023-11-08T19:42:12.778274+0000","last_fullsized":"2023-11-08T19:42:12.778274+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740648,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.61699999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.67900000000000005,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.72799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.73999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740650,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.71099999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66100000000000003,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.501}]},{"osd":2,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58299999999999996}]}]},{"osd":1,"up_from":7,"seq":30064773350,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.436,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57299999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:42:20.757 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.758 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.758 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.759 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.760 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.760 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.761 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.761 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.762 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.762 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.763 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.763 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.764 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:20.764 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:42:20.917 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:20.913+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:21.359 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:21.357+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:21.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:21.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:21.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:21.961+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:22.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:22.369+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:22.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:22.789+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:22.937 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:22.933+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:23.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:23.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:23.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:23.761+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:23.975 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:23.973+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:24.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:24.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:24.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:24.777+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:24.941 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:24.937+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:25.334 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:25.333+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:25.775 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:25.773+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:25.931 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:25.929+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:26.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:26.317+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:26.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:26.749+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:26.949 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:26.945+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:27.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:27.337+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:27.709 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:27.705+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:27.968 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:27.965+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:28.379 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:28.377+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:28.700 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:28.697+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:29.012 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:29.009+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:29.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:29.325+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:29.722 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:29.717+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:30.002 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:29.997+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:30.300 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:30.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:30.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:30.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:31.026 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:31.021+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:31.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:31.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:31.676 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:31.673+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:32.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:32.041+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:32.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:32.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:32.671 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:32.669+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:33.053 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:33.049+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:33.312 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:33.309+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:33.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:33.625+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:34.042 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:34.037+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:34.299 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:34.297+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:34.586 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:34.581+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:35.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:35.077+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:35.325 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:35.321+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:35.547 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:35.545+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:36.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:36.101+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:36.330 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:36.329+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:36.581 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:36.577+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:37.144 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:37.141+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:37.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:37.365+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:37.596 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:37.592+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:38.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:38.168+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:38.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:38.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:38.629 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:38.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:39.222 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:39.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:39.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:39.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:39.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:39.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:40.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:40.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:40.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:40.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:40.589 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:40.584+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:40.766 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:42:41.096 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:42:41.101 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:42:41.112 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5850,"stamp":"2023-11-08T19:42:39.398437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003280"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1855,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:42:37.593589+0000","last_change":"2023-11-08T19:42:37.594751+0000","last_active":"2023-11-08T19:42:37.593589+0000","last_peered":"2023-11-08T19:42:37.593589+0000","last_clean":"2023-11-08T19:42:37.593589+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:42:37.593589+0000","last_undegraded":"2023-11-08T19:42:37.593589+0000","last_fullsized":"2023-11-08T19:42:37.593589+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740652,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.60299999999999998,"5min":0.65400000000000003,"15min":0.74199999999999999},"last":0.505},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.47799999999999998,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.65800000000000003,"5min":0.78100000000000003,"15min":0.97099999999999997},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Nov 8 19:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.67900000000000005,"5min":0.82399999999999995,"15min":0.90200000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.72799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.73299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740654,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.71099999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66100000000000003,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.63800000000000001}]}]},{"osd":1,"up_from":7,"seq":30064773354,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.436,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55700000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:42:41.114 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.114 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.115 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.115 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.116 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.116 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.116 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.117 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.117 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.117 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.118 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.118 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.119 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:42:41.119 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:42:41.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:41.224+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:41.428 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:41.424+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:41.571 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:41.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:42.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:42.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:42.406 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:42.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:42.606 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:42.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:43.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:43.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:43.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:43.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:43.566 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:43.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:44.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:44.232+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:44.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:44.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:44.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:44.520+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:45.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:45.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:45.341 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:45.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:45.569 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:45.564+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:46.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:46.272+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:46.322 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:46.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:46.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:46.572+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:47.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:47.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:47.321 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:47.316+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:47.601 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:47.596+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:48.302 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:48.296+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:48.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:48.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:48.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:48.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:49.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:49.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:49.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:49.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:49.572 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:49.568+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:50.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:50.240+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:50.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:50.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:50.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:50.532+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:51.253 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:51.248+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:51.342 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:51.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:51.564 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:51.560+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:52.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:52.204+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:52.321 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:52.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:52.608 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:52.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:53.188 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:53.184+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:53.328 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:53.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:53.645 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:53.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:54.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:54.216+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:54.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:54.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:54.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:54.604+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:55.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:55.188+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:55.296 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:55.292+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:55.631 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:55.628+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:56.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:56.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:56.286 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:56.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:56.679 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:56.676+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:57.202 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:57.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:57.283 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:57.280+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:57.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:57.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:58.155 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:58.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:58.287 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:58.284+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:58.664 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:58.660+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:59.180 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:42:59.176+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:42:59.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:42:59.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:42:59.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:42:59.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:00.156 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:00.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:00.306 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:00.304+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:00.701 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:00.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:01.120 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:43:01.157 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:01.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:01.355 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:01.352+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:01.403 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:43:01.405 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:43:01.415 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5860,"stamp":"2023-11-08T19:42:59.403875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003250"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1869,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:42:55.627622+0000","last_change":"2023-11-08T19:42:55.628665+0000","last_active":"2023-11-08T19:42:55.627622+0000","last_peered":"2023-11-08T19:42:55.627622+0000","last_clean":"2023-11-08T19:42:55.627622+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:42:55.627622+0000","last_undegraded":"2023-11-08T19:42:55.627622+0000","last_fullsized":"2023-11-08T19:42:55.627622+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740656,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.751,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60499999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.51300000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.68500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740658,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.71099999999999997},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.66100000000000003,"5min":0.76200000000000001,"15min":1.0109999999999999},"last":0.623}]},{"osd":2,"last update":"Wed Nov 8 19:42:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.49299999999999999,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.95299999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48699999999999999},"max":{"1min":0.72199999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":7,"seq":30064773358,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.436,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.44400000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:42:06 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59699999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.46600000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:43:01.417 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.418 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.418 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.418 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.419 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.419 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.419 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.420 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.420 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.420 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.421 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.421 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.422 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:01.422 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:43:01.705 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:01.700+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:02.138 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:02.132+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:02.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:02.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:02.702 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:02.696+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:03.124 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:03.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:03.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:03.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:03.724 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:03.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:04.158 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:04.152+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:04.393 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:04.388+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:04.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:04.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:05.151 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:05.148+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:05.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:05.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:05.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:05.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:06.107 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:06.104+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:06.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:06.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:06.718 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:06.712+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:07.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:07.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:07.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:07.416+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:07.678 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:07.672+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:08.091 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:08.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:08.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:08.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:08.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:08.712+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:09.094 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:09.088+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:09.394 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:09.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:09.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:09.700+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:10.114 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:10.108+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:10.366 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:10.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:10.695 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:10.692+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:11.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:11.120+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:11.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:11.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:11.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:11.720+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:12.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:12.128+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:12.383 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:12.380+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:12.683 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:12.680+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:13.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:13.116+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:13.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:13.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:13.674 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:13.668+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:14.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:14.156+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:14.367 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:14.364+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:14.643 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:14.640+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:15.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:15.208+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:15.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:15.376+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:15.668 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:15.664+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:16.224 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:16.220+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:16.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:16.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:16.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:16.624+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:17.200 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:17.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:17.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:17.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:17.660 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:17.656+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:18.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:18.164+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:18.396 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:18.392+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:18.625 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:18.620+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:19.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:19.160+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:19.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:19.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:19.592 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:19.588+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:20.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:20.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:20.401 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:20.396+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:20.598 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:20.592+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:21.201 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:21.196+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:21.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:21.404+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:21.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:43:21.580 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:21.576+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:21.705 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:43:21.707 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:43:21.718 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5871,"stamp":"2023-11-08T19:43:21.409769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003241"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1885,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:43:14.641093+0000","last_change":"2023-11-08T19:43:14.642324+0000","last_active":"2023-11-08T19:43:14.641093+0000","last_peered":"2023-11-08T19:43:14.641093+0000","last_clean":"2023-11-08T19:43:14.641093+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:43:14.641093+0000","last_undegraded":"2023-11-08T19:43:14.641093+0000","last_fullsized":"2023-11-08T19:43:14.641093+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740660,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.751,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.496}]},{"osd":1,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.51300000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740662,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.44700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":1.0109999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.69499999999999995,"5min":0.72799999999999998,"15min":0.76300000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.621},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.48999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.626}]}]},{"osd":1,"up_from":7,"seq":30064773362,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.63300000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.48399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.52800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:43:21.721 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.722 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.722 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.723 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.724 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.725 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.725 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.726 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.727 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.727 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.728 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.729 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.729 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:21.730 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:43:22.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:22.228+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:22.371 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:22.368+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:22.546 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:22.544+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:23.267 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:23.264+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:23.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:23.324+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:23.597 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:23.592+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:24.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:24.236+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:24.320 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:24.316+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:24.610 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:24.603+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:25.218 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:25.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:25.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:25.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:25.620 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:25.615+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:26.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:26.227+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:26.329 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:26.323+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:26.578 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:26.571+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:27.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:27.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:27.335 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:27.331+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:27.553 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:27.547+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:28.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:28.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:28.356 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:28.351+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:28.525 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:28.519+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:29.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:29.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:29.402 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:29.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:29.494 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:29.487+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:30.311 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:30.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:30.400 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:30.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:30.482 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:30.475+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:31.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:31.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:31.358 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:31.355+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:31.471 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:31.467+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:32.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:32.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:32.392 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:32.387+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:32.507 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:32.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:33.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:33.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:33.385 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:33.379+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:33.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:33.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:34.356 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:34.351+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:34.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:34.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:34.573 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:34.567+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:35.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:35.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:35.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:35.403+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:35.538 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:35.535+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:36.391 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:36.387+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:36.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:36.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:36.544 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:36.539+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:37.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:37.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:37.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:37.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:37.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:37.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:38.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:38.375+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:38.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:38.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:38.562 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:38.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:39.349 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:39.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:39.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:39.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:39.526 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:39.523+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:40.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:40.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:40.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:40.467+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:40.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:40.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:41.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:41.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:41.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:41.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:41.506 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:41.503+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:41.731 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:43:42.015 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:43:42.018 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:43:42.028 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5881,"stamp":"2023-11-08T19:43:41.415426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003536"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1899,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:43:37.524330+0000","last_change":"2023-11-08T19:43:37.525322+0000","last_active":"2023-11-08T19:43:37.524330+0000","last_peered":"2023-11-08T19:43:37.524330+0000","last_clean":"2023-11-08T19:43:37.524330+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:43:37.524330+0000","last_undegraded":"2023-11-08T19:43:37.524330+0000","last_fullsized":"2023-11-08T19:43:37.524330+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740664,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51000000000000001,"15min":0.51200000000000001},"min":{"1min":0.41799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.46700000000000003,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.751,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.47399999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65200000000000002,"15min":0.64000000000000001},"min":{"1min":0.51300000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.85799999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.61699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740666,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.44700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":1.0109999999999999},"last":0.64200000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.69499999999999995,"5min":0.72799999999999998,"15min":0.76300000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.621},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.48999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71899999999999997}]}]},{"osd":1,"up_from":7,"seq":30064773366,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.63300000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.48399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.51200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:43:42.030 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.030 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.031 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.031 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.031 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.032 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.032 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.033 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.033 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.033 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.034 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.035 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.035 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:43:42.035 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:43:42.310 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:43:42.320 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:43:42.350 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:42.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:42.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:42.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:42.532 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:42.527+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:42.598 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:43:42.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:43:42.894 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:43:42.904 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:43:43.184 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:43:43.197 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:43:43.323 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:43.319+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:43.468 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:43:43.478 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:43:43.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:43.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:43.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:43.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:43.756 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:43:43.766 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:43:44.042 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:43:44.059 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:43:44.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:44.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:44.327 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:43:44.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:43:44.536 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:44.531+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:44.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:44.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:44.618 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:43:44.628 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:43:44.908 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:43:44.918 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:43:45.199 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:43:45.209 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:43:45.248 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:45.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:45.481 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:43:45.491 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:43:45.505 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:45.499+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:45.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:45.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:45.774 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:43:45.784 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:43:46.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:46.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:46.490 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:46.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:46.568 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:46.563+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:47.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:47.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:47.475 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:47.471+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:47.563 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:47.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:48.314 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:48.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:48.487 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:48.483+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:48.514 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:48.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:49.310 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:49.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:49.516 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:49.511+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:49.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:49.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:50.331 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:50.327+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:50.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:50.531+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:50.558 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:50.555+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:51.338 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:51.335+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:51.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:51.551+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:51.594 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:51.587+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:52.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:52.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:52.513 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:52.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:52.630 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:52.627+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:53.297 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:53.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:53.500 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:53.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:53.624 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:53.619+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:54.282 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:54.275+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:54.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:54.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:54.654 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:54.647+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:55.290 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:55.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:55.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:55.471+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:55.704 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:55.699+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:56.291 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:56.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:56.516 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:56.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:56.721 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:56.715+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:57.322 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:57.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:57.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:57.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:57.715 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:57.711+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:58.308 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:58.303+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:58.511 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:58.507+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:58.741 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:58.735+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:59.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:43:59.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:43:59.545 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:43:59.539+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:43:59.735 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:43:59.731+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:00.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:00.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:00.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:00.555+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:00.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:00.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:01.247 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:01.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:01.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:01.535+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:01.657 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:01.651+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:02.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:02.223+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:02.586 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:02.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:02.707 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:02.703+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:03.190 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:03.183+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:03.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:03.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:03.689 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:03.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:04.152 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:04.147+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:04.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:04.639+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:04.731 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:04.727+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:05.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:05.139+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:05.596 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:05.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:05.690 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:05.683+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:05.785 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:44:06.070 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:44:06.073 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:44:06.085 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5893,"stamp":"2023-11-08T19:44:05.422015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003301"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1921,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:44:03.686924+0000","last_change":"2023-11-08T19:44:03.687943+0000","last_active":"2023-11-08T19:44:03.686924+0000","last_peered":"2023-11-08T19:44:03.686924+0000","last_clean":"2023-11-08T19:44:03.686924+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:44:03.686924+0000","last_undegraded":"2023-11-08T19:44:03.686924+0000","last_fullsized":"2023-11-08T19:44:03.686924+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740669,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.438},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.68300000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740671,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.44700000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.46200000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.70899999999999996,"5min":0.71999999999999997,"15min":1.0109999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"min":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.46300000000000002},"max":{"1min":0.69499999999999995,"5min":0.72799999999999998,"15min":0.76300000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.621},"min":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.48999999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63300000000000001}]}]},{"osd":1,"up_from":7,"seq":30064773371,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.63300000000000001,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.627},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.48399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.69999999999999996,"5min":0.77000000000000002,"15min":0.78300000000000003},"last":0.68600000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:43:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.59799999999999998},"min":{"1min":0.51600000000000001,"5min":0.47399999999999998,"15min":0.40100000000000002},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.82699999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58999999999999997,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68600000000000005,"5min":0.73999999999999999,"15min":0.80300000000000005},"last":0.64900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:44:06.087 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.087 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.088 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.088 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.088 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.089 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.089 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.090 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.090 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.090 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.091 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.091 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.091 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:06.092 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:44:06.136 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:06.131+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:06.637 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:06.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:06.727 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:06.723+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:07.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:07.171+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:07.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:07.631+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:07.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:07.691+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:08.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:08.211+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:08.659 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:08.655+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:08.674 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:08.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:09.227 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:09.223+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:09.618 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:09.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:09.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:09.623+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:10.205 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:10.199+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:10.615 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:10.611+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:10.658 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:10.651+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:11.170 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:11.163+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:11.656 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:11.650+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:11.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:11.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:12.214 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:12.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:12.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:12.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:12.687 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:12.682+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:13.209 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:13.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:13.696 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:13.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:13.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:13.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:14.231 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:14.226+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:14.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:14.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:14.728 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:14.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:15.241 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:15.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:15.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:15.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:15.698 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:15.690+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:16.219 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:16.214+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:16.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:16.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:16.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:16.706+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:17.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:17.198+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:17.676 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:17.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:17.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:17.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:18.161 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:18.154+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:18.694 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:18.690+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:18.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:18.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:19.165 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:19.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:19.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:19.682+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:19.764 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:19.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:20.154 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:20.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:20.691 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:20.686+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:20.778 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:20.770+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:21.198 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:21.190+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:21.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:21.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:21.771 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:21.766+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:22.229 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:22.222+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:22.627 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:22.622+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:22.747 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:22.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:23.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:23.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:23.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:23.658+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:23.729 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:23.722+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:24.174 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:24.166+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:24.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:24.702+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:24.734 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:24.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:25.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:25.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:25.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:25.670+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:25.725 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:25.718+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:26.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:44:26.149 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:26.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:26.373 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:44:26.375 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:44:26.390 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5903,"stamp":"2023-11-08T19:44:25.427560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003394"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1947,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:44:21.769643+0000","last_change":"2023-11-08T19:44:21.770700+0000","last_active":"2023-11-08T19:44:21.769643+0000","last_peered":"2023-11-08T19:44:21.769643+0000","last_clean":"2023-11-08T19:44:21.769643+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:44:21.769643+0000","last_undegraded":"2023-11-08T19:44:21.769643+0000","last_fullsized":"2023-11-08T19:44:21.769643+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740673,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60799999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.68300000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.52600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740675,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.76300000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.873,"15min":0.873},"last":0.59399999999999997}]}]},{"osd":1,"up_from":7,"seq":30064773375,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.61599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:44:26.392 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.393 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.393 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.393 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.394 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.394 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.395 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.395 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.395 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.396 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.396 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.396 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.397 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:26.397 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:44:26.680 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:26.674+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:26.703 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:26.698+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:27.130 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:27.122+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:27.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:27.634+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:27.717 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:27.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:28.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:28.162+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:28.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:28.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:28.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:28.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:29.162 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:29.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:29.579 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:29.574+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:29.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:29.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:30.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:30.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:30.611 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:30.606+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:30.790 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:30.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:31.134 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:31.130+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:31.623 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:31.618+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:31.780 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:31.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:32.108 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:32.102+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:32.633 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:32.626+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:32.802 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:32.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:33.081 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:33.074+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:33.607 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:33.602+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:33.770 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:33.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:34.123 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:34.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:34.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:34.590+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:34.736 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:34.730+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:35.142 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:35.134+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:35.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:35.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:35.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:35.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:36.153 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:36.146+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:36.518 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:36.514+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:36.716 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:36.710+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:37.122 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:37.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:37.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:37.482+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:37.740 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:37.734+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:38.106 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:38.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:38.506 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:38.498+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:38.751 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:38.746+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:39.059 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:39.054+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:39.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:39.474+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:39.733 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:39.726+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:40.105 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:40.098+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:40.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:40.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:40.779 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:40.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:41.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:41.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:41.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:41.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:41.789 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:41.782+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:42.119 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:42.114+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:42.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:42.390+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:42.781 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:42.774+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:43.123 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:43.118+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:43.350 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:43.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:43.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:43.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:44.143 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:44.138+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:44.380 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:44.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:44.765 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:44.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:45.177 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:45.170+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:45.352 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:45.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:45.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:45.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:46.221 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:46.214+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:46.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:46.370+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:46.398 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:44:46.692 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:44:46.694 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:44:46.704 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5913,"stamp":"2023-11-08T19:44:45.432920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003094"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1955,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:44:39.731282+0000","last_change":"2023-11-08T19:44:39.732477+0000","last_active":"2023-11-08T19:44:39.731282+0000","last_peered":"2023-11-08T19:44:39.731282+0000","last_clean":"2023-11-08T19:44:39.731282+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:44:39.731282+0000","last_undegraded":"2023-11-08T19:44:39.731282+0000","last_fullsized":"2023-11-08T19:44:39.731282+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740677,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.504,"15min":0.51100000000000001},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.442},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60899999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:43:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.64400000000000002,"15min":0.63900000000000001},"min":{"1min":0.52200000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.68300000000000005,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740679,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.76300000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.873,"15min":0.873},"last":0.55000000000000004}]}]},{"osd":1,"up_from":7,"seq":30064773379,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.61699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:44:46.706 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.707 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.707 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.707 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.708 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.708 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.709 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.709 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.710 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.710 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.711 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.711 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.712 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:44:46.712 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:44:46.805 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:46.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:47.251 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:47.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:47.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:47.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:47.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:47.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:48.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:48.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:48.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:48.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:48.869 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:48.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:49.211 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:49.206+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:49.435 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:49.430+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:49.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:49.878+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:50.245 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:50.238+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:50.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:50.442+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:50.858 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:50.850+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:51.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:51.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:51.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:51.426+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:51.910 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:51.902+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:52.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:52.266+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:52.453 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:52.446+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:52.892 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:52.886+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:53.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:53.230+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:53.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:53.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:53.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:53.910+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:54.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:54.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:54.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:54.502+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:54.920 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:54.914+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:55.320 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:55.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:55.550 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:55.542+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:55.931 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:55.926+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:56.326 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:56.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:56.561 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:56.554+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:56.905 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:56.898+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:57.354 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:57.350+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:57.587 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:57.582+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:57.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:57.950+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:58.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:58.370+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:58.631 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:58.625+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:44:58.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:44:58.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:59.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:44:59.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:44:59.588 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:44:59.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:00.028 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:00.021+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:00.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:00.441+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:00.626 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:00.621+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:01.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:01.069+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:01.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:01.481+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:01.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:01.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:02.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:02.089+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:02.458 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:02.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:02.601 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:02.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:03.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:03.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:03.421 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:03.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:03.641 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:03.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:04.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:04.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:04.431 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:04.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:04.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:04.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:05.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:05.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:05.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:05.473+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:05.695 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:05.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:06.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:06.113+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:06.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:06.521+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:06.714 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:45:06.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:06.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:07.001 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:45:07.004 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:45:07.015 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5923,"stamp":"2023-11-08T19:45:05.438141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003164"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1965,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:44:57.952746+0000","last_change":"2023-11-08T19:44:57.953851+0000","last_active":"2023-11-08T19:44:57.952746+0000","last_peered":"2023-11-08T19:44:57.952746+0000","last_clean":"2023-11-08T19:44:57.952746+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:44:57.952746+0000","last_undegraded":"2023-11-08T19:44:57.952746+0000","last_fullsized":"2023-11-08T19:44:57.952746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740681,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.375},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.60699999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48699999999999999},"max":{"1min":0.73299999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740683,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:44:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.76300000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.622},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85499999999999998,"5min":0.873,"15min":0.873},"last":0.60699999999999998}]}]},{"osd":1,"up_from":7,"seq":30064773383,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.41799999999999998,"5min":0.308,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:44:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.58099999999999996,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.66000000000000003,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:45:07.017 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.018 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.019 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.019 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.019 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.021 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.021 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.022 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.022 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.023 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.023 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.024 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.024 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:07.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:45:07.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:07.081+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:07.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:07.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:07.759 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:07.753+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:08.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:08.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:08.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:08.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:08.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:08.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:09.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:09.101+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:09.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:09.581+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:09.697 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:09.693+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:10.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:10.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:10.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:10.577+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:10.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:10.665+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:11.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:11.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:11.627 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:11.625+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:11.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:11.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:12.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:12.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:12.598 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:12.597+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:12.758 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:12.753+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:13.154 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:13.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:13.640 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:13.637+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:13.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:13.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:14.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:14.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:14.605 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:14.601+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:14.703 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:14.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:15.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:15.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:15.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:15.553+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:15.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:15.737+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:16.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:16.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:16.545 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:16.541+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:16.769 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:16.765+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:17.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:17.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:17.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:17.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:17.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:17.753+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:18.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:18.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:18.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:18.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:18.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:18.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:19.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:19.157+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:19.508 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:19.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:19.706 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:19.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:20.155 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:20.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:20.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:20.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:20.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:20.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:21.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:21.177+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:21.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:21.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:21.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:21.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:22.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:22.149+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:22.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:22.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:22.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:22.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:23.204 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:23.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:23.407 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:23.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:23.757 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:23.753+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:24.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:24.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:24.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:24.369+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:24.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:24.733+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:25.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:25.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:25.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:25.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:25.739 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:25.737+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:26.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:26.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:26.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:26.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:26.751 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:26.749+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:27.026 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:45:27.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:27.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:27.308 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:45:27.311 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:45:27.320 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5933,"stamp":"2023-11-08T19:45:25.443461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003226"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1975,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:45:21.179862+0000","last_change":"2023-11-08T19:45:21.181053+0000","last_active":"2023-11-08T19:45:21.179862+0000","last_peered":"2023-11-08T19:45:21.179862+0000","last_clean":"2023-11-08T19:45:21.179862+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:45:21.179862+0000","last_undegraded":"2023-11-08T19:45:21.179862+0000","last_fullsized":"2023-11-08T19:45:21.179862+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740685,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.375},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.435},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51800000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48699999999999999},"max":{"1min":0.73299999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.57799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740687,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.68200000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.66900000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.624}]}]},{"osd":1,"up_from":7,"seq":30064773387,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.44900000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68700000000000006,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.499}]},{"osd":2,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:45:27.322 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.322 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.323 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.323 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.323 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.324 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.324 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.325 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.325 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.325 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.326 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.326 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.327 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:27.327 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:45:27.422 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:27.421+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:27.731 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:27.729+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:28.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:28.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:28.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:28.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:28.754 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:28.749+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:29.186 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:29.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:29.381 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:29.377+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:29.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:29.725+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:30.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:30.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:30.396 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:30.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:30.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:30.725+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:31.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:31.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:31.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:31.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:31.763 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:31.761+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:32.144 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:32.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:32.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:32.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:32.775 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:32.773+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:33.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:33.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:33.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:33.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:33.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:33.769+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:34.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:34.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:34.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:34.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:34.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:34.809+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:35.227 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:35.225+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:35.480 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:35.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:35.827 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:35.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:36.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:36.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:36.505 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:36.501+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:36.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:36.817+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:37.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:37.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:37.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:37.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:37.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:37.789+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:38.265 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:38.261+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:38.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:38.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:38.813 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:38.809+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:39.242 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:39.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:39.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:39.497+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:39.781 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:39.777+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:40.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:40.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:40.551 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:40.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:40.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:40.801+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:41.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:41.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:41.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:41.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:41.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:41.825+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:42.239 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:42.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:42.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:42.549+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:42.855 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:42.853+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:43.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:43.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:43.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:43.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:43.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:43.813+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:44.163 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:44.161+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:44.565 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:44.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:44.805 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:44.801+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:45.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:45.117+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:45.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:45.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:45.821 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:45.816+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:46.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:46.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:46.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:46.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:46.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:46.800+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:47.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:47.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:47.329 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:45:47.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:47.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:47.608 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:45:47.610 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:45:47.625 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5944,"stamp":"2023-11-08T19:45:47.449837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003587"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":1989,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:45:42.236967+0000","last_change":"2023-11-08T19:45:42.238045+0000","last_active":"2023-11-08T19:45:42.236967+0000","last_peered":"2023-11-08T19:45:42.236967+0000","last_clean":"2023-11-08T19:45:42.236967+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:45:42.236967+0000","last_undegraded":"2023-11-08T19:45:42.236967+0000","last_fullsized":"2023-11-08T19:45:42.236967+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740689,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.375},"max":{"1min":0.64100000000000001,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.47399999999999998,"5min":0.44,"15min":0.41499999999999998},"max":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:44:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.48099999999999998,"5min":0.437,"15min":0.437},"max":{"1min":0.72099999999999997,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.64700000000000002,"15min":0.63800000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.48699999999999999},"max":{"1min":0.73299999999999998,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359740691,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.68200000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.66900000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.64200000000000002}]}]},{"osd":1,"up_from":7,"seq":30064773391,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.44900000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68700000000000006,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437}]},{"osd":2,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.625}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:45:47.628 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.629 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.629 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.630 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.631 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.631 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.632 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.632 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.633 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.634 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.634 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.635 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.636 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:45:47.636 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:45:47.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:47.816+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:47.914 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:45:47.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:45:48.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:48.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:48.198 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:45:48.208 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:45:48.491 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:45:48.501 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:45:48.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:48.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:48.774 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:45:48.784 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:45:48.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:48.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:49.062 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:45:49.075 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:45:49.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:49.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:49.353 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:45:49.366 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:45:49.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:49.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:49.648 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:45:49.661 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:45:49.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:49.828+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:49.940 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:45:49.950 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:45:50.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:50.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:50.217 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:45:50.232 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:45:50.517 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:45:50.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:45:50.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:50.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:50.805 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:45:50.815 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:45:50.858 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:50.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:51.093 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:45:51.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:51.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:51.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:45:51.379 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:45:51.390 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:45:51.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:51.548+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:51.907 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:51.904+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:52.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:52.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:52.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:52.580+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:52.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:52.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:53.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:53.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:53.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:53.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:53.942 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:53.940+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:54.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:54.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:54.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:54.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:54.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:54.972+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:55.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:55.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:55.556 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:55.552+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:55.966 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:55.960+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:56.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:56.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:56.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:56.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:56.952 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:56.948+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:57.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:57.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:57.575 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:57.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:57.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:57.904+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:58.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:58.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:58.601 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:58.596+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:58.926 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:58.920+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:45:59.223 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:45:59.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:59.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:45:59.560+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:45:59.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:45:59.892+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:00.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:00.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:00.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:00.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:00.871 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:00.868+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:01.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:01.220+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:01.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:01.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:01.822 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:01.816+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:02.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:02.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:02.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:02.628+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:02.792 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:02.788+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:03.229 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:03.224+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:03.609 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:03.604+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:03.785 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:03.780+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:04.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:04.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:04.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:04.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:04.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:04.828+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:05.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:05.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:05.633 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:05.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:05.865 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:05.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:06.099 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:06.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:06.630 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:06.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:06.849 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:06.844+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:07.136 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:07.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:07.679 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:07.676+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:07.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:07.800+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:08.091 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:08.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:08.657 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:08.652+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:08.756 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:08.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:09.109 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:09.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:09.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:09.664+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:09.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:09.784+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:10.128 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:10.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:10.637 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:10.632+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:10.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:10.796+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:11.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:11.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:11.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:46:11.666 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:11.660+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:11.675 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:46:11.678 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:46:11.688 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5956,"stamp":"2023-11-08T19:46:11.456395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003413"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2013,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:46:05.144092+0000","last_change":"2023-11-08T19:46:05.145316+0000","last_active":"2023-11-08T19:46:05.144092+0000","last_peered":"2023-11-08T19:46:05.144092+0000","last_clean":"2023-11-08T19:46:05.144092+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:46:05.144092+0000","last_undegraded":"2023-11-08T19:46:05.144092+0000","last_fullsized":"2023-11-08T19:46:05.144092+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740694,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,3,4,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.76400000000000001,"5min":0.85799999999999998,"15min":1.4530000000000001},"last":0.64100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740696,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51600000000000001,"15min":0.52400000000000002},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.68200000000000005,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69899999999999995,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:45:09 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.66900000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.74199999999999999,"5min":0.873,"15min":0.873},"last":0.68799999999999994}]}]},{"osd":1,"up_from":7,"seq":30064773396,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.52500000000000002},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.69499999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.44900000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68700000000000006,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.68600000000000005,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.629},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58999999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.80100000000000005},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:46:11.690 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.690 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.691 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.691 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.691 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.692 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.692 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.693 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.693 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.693 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.694 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.694 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.695 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:11.695 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:46:11.765 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:11.760+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:12.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:12.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:12.628 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:12.624+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:12.742 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:12.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:13.114 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:13.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:13.646 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:13.644+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:13.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:13.688+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:14.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:14.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:14.613 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:14.608+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:14.740 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:14.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:15.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:15.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:15.604 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:15.600+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:15.767 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:15.764+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:16.157 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:16.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:16.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:16.576+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:16.815 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:16.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:17.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:17.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:17.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:17.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:17.862 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:17.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:18.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:18.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:18.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:18.536+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:18.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:18.904+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:19.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:19.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:19.501 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:19.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:19.938 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:19.936+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:20.203 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:20.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:20.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:20.496+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:20.936 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:20.932+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:21.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:21.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:21.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:21.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:21.902 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:21.896+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:22.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:22.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:22.483 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:22.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:22.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:22.932+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:23.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:23.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:23.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:23.532+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:23.904 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:23.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:24.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:24.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:24.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:24.492+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:24.906 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:24.900+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:25.210 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:25.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:25.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:25.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:25.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:25.884+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:26.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:26.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:26.506 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:26.504+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:26.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:26.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:27.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:27.196+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:27.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:27.524+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:27.859 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:27.856+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:28.194 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:28.192+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:28.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:28.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:28.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:28.824+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:29.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:29.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:29.548 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:29.544+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:29.866 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:29.860+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:30.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:30.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:30.521 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:30.516+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:30.854 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:30.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:31.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:31.256+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:31.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:31.480+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:31.696 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:46:31.835 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:31.832+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:31.979 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:46:31.983 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:46:31.996 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5966,"stamp":"2023-11-08T19:46:31.461946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003353"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2025,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:46:27.196539+0000","last_change":"2023-11-08T19:46:27.197571+0000","last_active":"2023-11-08T19:46:27.196539+0000","last_peered":"2023-11-08T19:46:27.196539+0000","last_clean":"2023-11-08T19:46:27.196539+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:46:27.196539+0000","last_undegraded":"2023-11-08T19:46:27.196539+0000","last_fullsized":"2023-11-08T19:46:27.196539+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740698,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.76400000000000001,"5min":0.85799999999999998,"15min":1.4530000000000001},"last":0.65300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740700,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.51700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73399999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.68600000000000005,"5min":0.75,"15min":0.76300000000000001},"last":0.504},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.623},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71199999999999997,"5min":0.873,"15min":0.873},"last":0.64000000000000001}]}]},{"osd":1,"up_from":7,"seq":30064773400,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.629,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:46:31.997 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:31.998 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:31.998 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:31.999 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:31.999 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:31.999 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.000 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.000 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.001 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.001 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.002 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.002 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.003 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:32.003 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:46:32.264 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:32.260+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:32.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:32.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:32.794 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:32.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:33.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:33.247+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:33.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:33.487+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:33.788 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:33.783+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:34.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:34.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:34.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:34.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:34.749 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:34.743+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:35.217 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:35.211+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:35.477 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:35.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:35.712 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:35.707+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:36.197 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:36.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:36.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:36.431+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:36.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:36.699+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:37.220 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:37.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:37.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:37.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:37.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:37.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:38.255 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:38.251+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:38.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:38.359+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:38.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:38.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:39.228 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:39.223+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:39.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:39.339+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:39.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:39.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:40.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:40.191+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:40.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:40.347+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:40.650 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:40.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:41.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:41.227+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:41.347 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:41.343+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:41.608 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:41.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:42.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:42.267+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:42.317 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:42.311+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:42.644 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:42.639+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:43.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:43.231+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:43.312 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:43.307+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:43.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:43.607+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:44.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:44.259+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:44.288 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:44.283+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:44.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:44.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:45.298 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:45.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:45.300 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:45.295+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:45.616 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:45.611+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:46.276 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:46.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:46.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:46.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:46.666 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:46.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:47.237 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:47.231+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:47.319 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:47.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:47.714 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:47.707+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:48.265 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:48.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:48.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:48.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:48.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:48.683+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:49.292 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:49.287+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:49.321 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:49.315+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:49.720 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:49.715+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:50.246 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:50.239+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:50.364 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:50.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:50.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:50.667+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:51.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:51.259+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:51.317 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:51.311+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:51.709 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:51.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:52.005 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:46:52.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:52.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:52.276 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:52.271+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:52.288 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:46:52.291 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:46:52.301 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5976,"stamp":"2023-11-08T19:46:51.467535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2039,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:46:48.307619+0000","last_change":"2023-11-08T19:46:48.308677+0000","last_active":"2023-11-08T19:46:48.307619+0000","last_peered":"2023-11-08T19:46:48.307619+0000","last_clean":"2023-11-08T19:46:48.307619+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:46:48.307619+0000","last_undegraded":"2023-11-08T19:46:48.307619+0000","last_fullsized":"2023-11-08T19:46:48.307619+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740702,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.499,"15min":0.51000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65900000000000003,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.629}]},{"osd":1,"last update":"Wed Nov 8 19:45:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.63500000000000001,"15min":0.63800000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.76400000000000001,"5min":0.85799999999999998,"15min":1.4530000000000001},"last":0.55000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740704,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.51700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73399999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.68600000000000005,"5min":0.75,"15min":0.76300000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.623},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71199999999999997,"5min":0.873,"15min":0.873},"last":0.625}]}]},{"osd":1,"up_from":7,"seq":30064773404,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.629,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:46:52.302 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.303 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.303 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.304 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.304 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.304 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.305 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.305 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.305 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.306 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.306 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.307 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.307 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:46:52.307 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:46:52.734 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:52.731+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:53.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:53.243+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:53.270 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:53.263+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:53.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:53.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:54.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:54.243+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:54.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:54.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:54.778 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:54.775+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:55.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:55.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:55.274 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:55.271+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:55.760 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:55.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:56.283 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:56.279+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:56.318 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:56.315+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:56.761 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:56.755+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:57.311 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:57.307+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:57.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:57.331+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:57.730 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:57.723+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:58.344 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:58.339+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:58.386 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:58.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:58.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:58.687+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:46:59.373 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:46:59.367+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:59.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:46:59.399+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:46:59.661 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:46:59.655+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:00.366 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:00.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:00.385 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:00.379+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:00.707 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:00.703+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:01.352 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:01.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:01.390 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:01.383+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:01.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:01.699+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:02.357 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:02.351+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:02.374 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:02.367+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:02.725 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:02.719+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:03.350 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:03.347+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:03.410 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:03.403+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:03.772 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:03.767+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:04.389 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:04.383+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:04.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:04.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:04.797 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:04.791+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:05.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:05.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:05.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:05.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:05.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:05.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:06.402 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:06.395+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:06.472 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:06.467+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:06.817 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:06.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:07.406 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:07.399+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:07.448 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:07.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:07.864 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:07.859+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:08.419 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:08.415+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:08.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:08.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:08.909 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:08.903+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:09.431 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:09.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:09.449 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:09.443+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:09.940 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:09.935+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:10.436 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:10.431+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:10.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:10.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:10.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:10.963+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:11.434 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:11.427+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:11.510 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:11.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:11.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:11.947+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:12.309 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:47:12.453 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:12.447+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:12.476 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:12.471+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:12.593 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:47:12.595 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:47:12.605 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5986,"stamp":"2023-11-08T19:47:11.473111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003341"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2051,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:47:07.404152+0000","last_change":"2023-11-08T19:47:07.405212+0000","last_active":"2023-11-08T19:47:07.404152+0000","last_peered":"2023-11-08T19:47:07.404152+0000","last_clean":"2023-11-08T19:47:07.404152+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:47:07.404152+0000","last_undegraded":"2023-11-08T19:47:07.404152+0000","last_fullsized":"2023-11-08T19:47:07.404152+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740706,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.41999999999999998},"max":{"1min":0.629,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.60499999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.69199999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740708,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39100000000000001},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55400000000000005,"15min":0.56100000000000005},"min":{"1min":0.51700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73399999999999999,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.68300000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:46:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.499,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.68600000000000005,"5min":0.75,"15min":0.76300000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.625,"15min":0.623},"min":{"1min":0.50900000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.71199999999999997,"5min":0.873,"15min":0.873},"last":0.55500000000000005}]}]},{"osd":1,"up_from":7,"seq":30064773408,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.30099999999999999},"max":{"1min":0.66900000000000004,"5min":0.70899999999999996,"15min":0.71699999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56499999999999995,"15min":0.56399999999999995},"min":{"1min":0.437,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.629,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed Nov 8 19:46:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.50600000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.745,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.72399999999999998,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:47:12.607 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.607 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.607 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.608 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.608 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.608 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.609 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.609 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.610 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.610 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.610 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.611 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.611 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:12.611 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:47:12.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:12.979+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:13.428 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:13.423+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:13.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:13.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:13.957 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:13.951+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:14.381 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:14.375+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:14.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:14.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:14.922 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:14.915+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:15.377 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:15.371+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:15.498 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:15.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:15.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:15.923+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:16.392 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:16.387+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:16.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:16.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:16.924 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:16.919+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:17.384 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:17.379+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:17.543 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:17.539+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:17.937 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:17.931+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:18.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:18.359+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:18.566 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:18.559+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:18.897 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:18.891+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:19.393 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:19.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:19.590 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:19.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:19.895 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:19.890+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:20.380 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:20.374+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:20.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:20.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:20.914 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:20.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:21.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:21.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:21.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:21.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:21.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:21.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:22.360 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:22.354+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:22.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:22.582+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:22.910 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:22.906+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:23.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:23.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:23.631 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:23.626+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:23.919 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:23.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:24.358 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:24.350+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:24.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:24.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:24.873 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:24.866+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:25.368 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:25.362+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:25.656 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:25.650+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:25.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:25.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:26.333 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:26.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:26.703 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:26.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:26.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:26.850+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:27.322 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:27.318+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:27.721 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:27.714+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:27.867 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:27.862+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:28.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:28.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:28.687 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:28.682+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:28.888 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:28.882+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:29.391 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:29.386+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:29.661 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:29.654+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:29.920 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:29.914+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:30.365 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:30.358+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:30.706 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:30.698+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:30.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:30.918+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:31.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:31.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:31.680 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:31.674+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:31.934 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:31.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:32.331 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:32.326+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:32.613 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:47:32.667 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:32.662+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:32.896 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:47:32.898 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:47:32.913 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":5996,"stamp":"2023-11-08T19:47:31.478470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2063,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:47:27.320422+0000","last_change":"2023-11-08T19:47:27.321556+0000","last_active":"2023-11-08T19:47:27.320422+0000","last_peered":"2023-11-08T19:47:27.320422+0000","last_clean":"2023-11-08T19:47:27.320422+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:47:27.320422+0000","last_undegraded":"2023-11-08T19:47:27.320422+0000","last_fullsized":"2023-11-08T19:47:27.320422+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740710,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.41999999999999998},"max":{"1min":0.629,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740712,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.66200000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.68300000000000005,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.75,"15min":0.76300000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.622},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.70499999999999996,"5min":0.873,"15min":0.873},"last":0.59699999999999998}]}]},{"osd":1,"up_from":7,"seq":30064773412,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71799999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71499999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70899999999999996,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:47:32.915 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.915 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.916 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.916 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.916 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.917 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.917 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.918 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.918 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.918 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.919 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.919 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.919 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:32.920 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:47:32.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:32.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:33.308 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:33.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:33.645 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:33.638+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:33.915 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:33.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:34.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:34.254+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:34.603 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:34.598+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:34.893 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:34.886+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:35.312 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:35.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:35.579 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:35.574+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:35.916 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:35.910+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:36.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:36.270+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:36.607 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:36.602+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:36.954 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:36.950+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:37.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:37.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:37.600 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:37.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:37.925 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:37.918+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:38.266 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:38.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:38.552 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:38.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:38.950 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:38.946+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:39.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:39.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:39.532 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:39.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:39.947 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:39.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:40.269 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:40.262+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:40.561 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:40.554+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:40.967 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:40.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:41.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:41.250+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:41.593 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:41.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:41.932 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:41.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:42.307 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:42.302+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:42.553 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:42.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:42.927 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:42.922+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:43.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:43.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:43.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:43.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:43.970 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:43.962+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:44.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:44.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:44.518 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:44.510+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:44.949 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:44.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:45.292 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:45.286+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:45.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:45.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:45.948 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:45.942+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:46.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:46.298+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:46.554 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:46.546+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:46.933 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:46.926+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:47.297 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:47.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:47.564 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:47.558+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:47.965 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:47.958+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:48.290 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:48.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:48.599 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:48.594+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:48.945 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:48.938+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:49.294 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:49.290+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:49.574 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:49.566+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:49.974 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:49.970+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:50.334 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:50.330+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:50.594 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:50.586+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:50.985 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:50.978+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:51.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:51.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:51.566 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:51.562+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:52.024 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:52.018+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:52.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:52.306+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:52.530 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:52.522+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:52.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:47:53.020 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:53.014+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:53.205 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:47:53.207 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:47:53.218 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6006,"stamp":"2023-11-08T19:47:51.483892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003149"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2071,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:47:48.287837+0000","last_change":"2023-11-08T19:47:48.288807+0000","last_active":"2023-11-08T19:47:48.287837+0000","last_peered":"2023-11-08T19:47:48.287837+0000","last_clean":"2023-11-08T19:47:48.287837+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:47:48.287837+0000","last_undegraded":"2023-11-08T19:47:48.287837+0000","last_fullsized":"2023-11-08T19:47:48.287837+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740714,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.42599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.60599999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46100000000000002,"5min":0.42399999999999999,"15min":0.41999999999999998},"max":{"1min":0.629,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:46:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56899999999999995,"15min":0.56699999999999995},"min":{"1min":0.47699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.73699999999999999,"5min":0.79900000000000004,"15min":0.82399999999999995},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.64000000000000001},"min":{"1min":0.55000000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.68999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740716,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.39100000000000001},"max":{"1min":0.66200000000000003,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.46600000000000003,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.68300000000000005,"5min":0.92400000000000004,"15min":1.0109999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:47:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.48099999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.75,"15min":0.76300000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.622},"min":{"1min":0.5,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.70499999999999996,"5min":0.873,"15min":0.873},"last":0.66300000000000003}]}]},{"osd":1,"up_from":7,"seq":30064773416,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71799999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71499999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70899999999999996,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:47:53.220 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.221 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.222 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.222 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.223 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.223 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.224 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.225 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.225 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.226 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.226 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.227 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.228 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:47:53.228 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:47:53.343 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:53.338+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:53.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:53.482+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:53.510 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:47:53.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:47:53.794 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:47:53.811 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:47:54.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:54.062+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:54.083 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:47:54.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:47:54.341 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:54.334+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:54.369 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:47:54.384 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:47:54.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:54.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:54.656 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:47:54.670 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:47:54.943 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:47:54.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:47:55.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:55.066+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:55.225 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:47:55.235 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:47:55.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:55.322+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:55.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:55.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:55.506 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:47:55.520 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:47:55.792 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:47:55.802 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:47:56.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:56.026+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:56.111 INFO:teuthology.orchestra.run.smithi196.stderr:2023-11-08T19:47:56.106+0000 7f7c6ffff700 0 --2- 172.21.15.196:0/3400218766 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7c70065d60 0x7f7c70090de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-11-08T19:47:56.280 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:47:56.286 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:56.282+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:56.290 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:47:56.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:56.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:56.773 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:47:56.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:47:57.052 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:47:57.053 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:57.046+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:57.065 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:47:57.273 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:57.266+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:57.344 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:47:57.359 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:47:57.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:57.474+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:58.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:58.082+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:58.240 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:58.234+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:58.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:58.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:59.107 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:47:59.102+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:47:59.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:47:59.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:47:59.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:47:59.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:00.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:00.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:00.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:00.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:00.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:00.362+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:01.145 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:01.138+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:01.263 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:01.258+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:01.319 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:01.314+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:02.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:02.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:02.234 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:02.226+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:02.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:02.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:03.158 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:03.150+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:03.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:03.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:03.363 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:03.358+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:04.178 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:04.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:04.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:04.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:04.324 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:04.318+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:05.170 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:05.162+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:05.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:05.206+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:05.361 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:05.354+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:06.220 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:06.214+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:06.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:06.218+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:06.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:06.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:07.183 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:07.177+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:07.251 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:07.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:07.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:07.437+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:08.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:08.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:08.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:08.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:08.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:08.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:09.132 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:09.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:09.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:09.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:09.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:09.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:10.131 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:10.125+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:10.249 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:10.241+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:10.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:10.477+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:11.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:11.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:11.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:11.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:11.473 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:11.465+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:12.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:12.137+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:12.224 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:12.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:12.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:12.425+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:13.154 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:13.145+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:13.221 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:13.213+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:13.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:13.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:14.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:14.153+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:14.245 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:14.237+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:14.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:14.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:15.172 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:15.165+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:15.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:15.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:15.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:15.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:16.175 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:16.169+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:16.198 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:16.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:16.434 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:16.429+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:17.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:17.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:17.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:17.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:17.360 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:48:17.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:17.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:17.643 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:48:17.645 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:48:17.662 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6019,"stamp":"2023-11-08T19:48:17.490588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003179"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2087,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:48:13.219377+0000","last_change":"2023-11-08T19:48:13.220504+0000","last_active":"2023-11-08T19:48:13.219377+0000","last_peered":"2023-11-08T19:48:13.219377+0000","last_clean":"2023-11-08T19:48:13.219377+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:48:13.219377+0000","last_undegraded":"2023-11-08T19:48:13.219377+0000","last_fullsized":"2023-11-08T19:48:13.219377+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740719,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.53600000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66800000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69899999999999995,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740721,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.69499999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.67500000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.623,"15min":0.623},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.72299999999999998,"5min":0.85499999999999998,"15min":0.873},"last":0.70099999999999996}]}]},{"osd":1,"up_from":7,"seq":30064773421,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.68700000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.433},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42899999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.71799999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:47:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.71499999999999997,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.58999999999999997},"min":{"1min":0.48399999999999999,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70899999999999996,"5min":0.73199999999999998,"15min":0.80100000000000005},"last":0.52200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:48:17.664 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.664 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.665 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.665 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.666 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.666 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.666 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.667 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.667 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.668 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.668 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.668 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.669 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:17.669 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:48:18.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:18.157+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:18.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:18.189+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:18.367 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:18.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:19.170 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:19.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:19.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:19.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:19.342 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:19.333+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:20.189 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:20.185+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:20.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:20.205+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:20.350 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:20.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:21.142 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:21.141+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:21.222 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:21.217+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:21.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:21.361+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:22.103 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:22.101+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:22.200 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:22.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:22.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:22.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:23.074 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:23.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:23.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:23.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:23.399 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:23.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:24.033 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:24.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:24.202 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:24.201+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:24.358 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:24.353+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:25.052 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:25.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:25.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:25.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:25.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:25.401+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:26.031 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:26.029+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:26.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:26.153+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:26.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:26.413+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:27.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:27.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:27.166 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:27.165+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:27.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:27.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:28.026 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:28.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:28.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:28.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:28.409 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:28.405+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:29.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:29.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:29.212 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:29.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:29.437 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:29.433+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:30.042 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:30.041+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:30.252 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:30.249+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:30.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:30.445+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:31.068 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:31.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:31.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:31.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:31.459 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:31.457+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:32.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:32.049+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:32.233 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:32.229+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:32.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:32.453+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:33.029 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:33.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:33.238 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:33.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:33.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:33.449+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:34.017 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:34.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:34.247 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:34.245+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:34.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:34.461+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:35.015 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:35.013+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:35.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:35.209+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:35.492 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:35.489+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:36.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:36.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:36.235 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:36.233+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:36.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:36.537+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:37.073 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:37.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:37.262 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:37.257+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:37.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:37.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:37.670 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:48:37.959 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:48:37.961 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:48:37.972 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6029,"stamp":"2023-11-08T19:48:37.496117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003510"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2109,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:48:32.230723+0000","last_change":"2023-11-08T19:48:32.231728+0000","last_active":"2023-11-08T19:48:32.230723+0000","last_peered":"2023-11-08T19:48:32.230723+0000","last_clean":"2023-11-08T19:48:32.230723+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:48:32.230723+0000","last_undegraded":"2023-11-08T19:48:32.230723+0000","last_fullsized":"2023-11-08T19:48:32.230723+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740723,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.55900000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66800000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69899999999999995,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.65500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740725,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.69499999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.67500000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.623,"15min":0.623},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.72299999999999998,"5min":0.85499999999999998,"15min":0.873},"last":0.64700000000000002}]}]},{"osd":1,"up_from":7,"seq":30064773425,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.432},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70199999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.80100000000000005},"last":0.53000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:48:37.973 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.974 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.974 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.975 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.975 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.976 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.976 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.977 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.977 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.978 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.978 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.979 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.979 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:37.979 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:48:38.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:38.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:38.295 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:38.293+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:38.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:38.493+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:39.100 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:39.097+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:39.288 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:39.285+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:39.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:39.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:40.055 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:40.053+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:40.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:40.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:40.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:40.513+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:41.087 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:41.085+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:41.301 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:41.297+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:41.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:41.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:42.122 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:42.121+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:42.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:42.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:42.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:42.469+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:43.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:43.077+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:43.277 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:43.273+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:43.519 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:43.517+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:44.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:44.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:44.324 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:44.321+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:44.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:44.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:45.037 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:45.033+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:45.313 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:45.309+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:45.489 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:45.485+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:46.028 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:46.025+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:46.272 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:46.269+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:46.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:46.525+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:47.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:47.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:47.268 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:47.265+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:47.568 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:47.565+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:47.975 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:47.973+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:48.305 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:48.301+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:48.563 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:48.561+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:49.023 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:49.021+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:49.309 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:49.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:49.588 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:49.585+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:50.072 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:50.069+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:50.306 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:50.305+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:50.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:50.573+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:51.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:51.065+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:51.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:51.325+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:51.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:51.533+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:52.022 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:52.017+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:52.328 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:52.325+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:52.509 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:52.505+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:53.011 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:53.009+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:53.351 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:53.348+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:53.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:53.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:54.038 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:54.036+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:54.339 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:54.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:54.454 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:54.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:55.035 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:55.032+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:55.330 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:55.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:55.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:55.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:56.070 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:56.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:56.354 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:56.352+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:56.402 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:56.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:57.060 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:57.056+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:57.337 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:57.332+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:57.380 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:57.376+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:57.981 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:48:58.064 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:58.060+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:58.260 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:48:58.263 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:48:58.273 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6039,"stamp":"2023-11-08T19:48:57.501666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003354"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2123,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:48:52.326586+0000","last_change":"2023-11-08T19:48:52.327537+0000","last_active":"2023-11-08T19:48:52.326586+0000","last_peered":"2023-11-08T19:48:52.326586+0000","last_clean":"2023-11-08T19:48:52.326586+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:48:52.326586+0000","last_undegraded":"2023-11-08T19:48:52.326586+0000","last_fullsized":"2023-11-08T19:48:52.326586+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740727,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.503,"15min":0.51000000000000001},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65700000000000003,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72299999999999998,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.502}]},{"osd":1,"last update":"Wed Nov 8 19:47:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.495,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66800000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.69899999999999995,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359740729,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.52400000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.69499999999999995,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.61499999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:48:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.45600000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.67500000000000004,"5min":0.75,"15min":0.76300000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.623,"15min":0.623},"min":{"1min":0.54200000000000004,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.72299999999999998,"5min":0.85499999999999998,"15min":0.873},"last":0.72499999999999998}]}]},{"osd":1,"up_from":7,"seq":30064773429,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.62}]},{"osd":2,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70199999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.80100000000000005},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:48:58.275 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.276 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.276 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.276 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.277 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.277 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.278 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.278 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.278 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.279 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.279 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.280 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.280 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:48:58.280 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:48:58.332 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:58.328+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:58.427 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:58.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:59.069 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:48:59.064+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:48:59.378 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:48:59.372+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:48:59.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:48:59.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:00.089 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:00.084+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:00.340 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:00.336+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:00.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:00.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:01.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:01.132+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:01.348 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:01.344+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:01.429 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:01.424+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:02.171 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:02.168+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:02.310 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:02.304+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:02.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:02.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:03.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:03.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:03.314 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:03.308+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:03.404 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:03.400+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:04.181 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:04.176+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:04.282 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:04.280+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:04.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:04.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:05.222 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:05.220+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:05.246 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:05.240+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:05.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:05.472+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:06.203 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:06.200+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:06.256 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:06.252+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:06.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:06.468+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:07.192 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:07.188+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:07.275 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:07.272+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:07.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:07.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:08.188 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:08.184+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:08.232 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:08.228+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:08.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:08.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:09.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:09.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:09.238 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:09.232+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:09.464 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:09.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:10.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:10.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:10.264 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:10.260+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:10.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:10.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:11.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:11.144+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:11.267 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:11.264+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:11.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:11.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:12.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:12.176+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:12.302 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:12.300+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:12.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:12.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:13.215 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:13.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:13.340 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:13.336+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:13.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:13.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:14.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:14.204+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:14.376 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:14.372+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:14.562 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:14.556+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:15.237 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:15.232+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:15.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:15.400+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:15.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:15.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:16.205 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:16.200+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:16.388 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:16.384+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:16.490 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:16.484+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:17.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:17.172+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:17.363 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:17.360+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:17.450 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:17.444+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:18.139 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:18.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:18.281 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:49:18.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:18.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:18.419 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:18.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:18.568 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:49:18.570 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:49:18.580 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6049,"stamp":"2023-11-08T19:49:17.507476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003418"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2141,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:49:13.213585+0000","last_change":"2023-11-08T19:49:13.214657+0000","last_active":"2023-11-08T19:49:13.213585+0000","last_peered":"2023-11-08T19:49:13.213585+0000","last_clean":"2023-11-08T19:49:13.213585+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:49:13.213585+0000","last_undegraded":"2023-11-08T19:49:13.213585+0000","last_fullsized":"2023-11-08T19:49:13.213585+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740731,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67100000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.48699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.55700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740733,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.45000000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.873},"last":0.55900000000000005}]}]},{"osd":1,"up_from":7,"seq":30064773433,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52900000000000003,"15min":0.52200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.69499999999999995,"15min":0.71699999999999997},"last":0.504},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:48:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.70199999999999996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"min":{"1min":0.47899999999999998,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.80100000000000005},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:49:18.582 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.582 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.582 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.583 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.583 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.584 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.584 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.585 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.585 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.585 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.586 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.586 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.587 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:18.587 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:49:19.185 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:19.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:19.420 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:19.416+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:19.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:19.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:20.161 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:20.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:20.435 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:20.432+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:20.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:20.472+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:21.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:21.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:21.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:21.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:21.488 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:21.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:22.211 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:22.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:22.451 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:22.448+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:22.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:22.476+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:23.214 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:23.208+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:23.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:23.484+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:23.491 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:23.488+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:24.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:24.212+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:24.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:24.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:24.517 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:24.512+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:25.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:25.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:25.413 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:25.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:25.470 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:25.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:26.190 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:26.184+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:26.418 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:26.412+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:26.456 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:26.452+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:27.172 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:27.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:27.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:27.428+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:27.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:27.464+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:28.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:28.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:28.424 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:28.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:28.434 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:28.432+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:29.127 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:29.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:29.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:29.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:29.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:29.460+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:30.165 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:30.160+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:30.446 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:30.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:30.460 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:30.456+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:31.141 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:31.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:31.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:31.428+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:31.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:31.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:32.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:32.132+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:32.400 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:32.396+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:32.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:32.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:33.111 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:33.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:33.366 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:33.360+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:33.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:33.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:34.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:34.116+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:34.416 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:34.412+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:34.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:34.436+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:35.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:35.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:35.425 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:35.420+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:35.457 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:35.452+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:36.159 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:36.156+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:36.443 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:36.440+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:36.444 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:36.440+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:37.142 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:37.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:37.481 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:37.476+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:37.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:37.480+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:38.193 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:38.188+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:38.449 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:38.444+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:38.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:38.520+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:38.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:49:38.873 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:49:38.875 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:49:38.886 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6059,"stamp":"2023-11-08T19:49:37.513100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003317"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2155,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:49:30.163107+0000","last_change":"2023-11-08T19:49:30.164211+0000","last_active":"2023-11-08T19:49:30.163107+0000","last_peered":"2023-11-08T19:49:30.163107+0000","last_clean":"2023-11-08T19:49:30.163107+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:49:30.163107+0000","last_undegraded":"2023-11-08T19:49:30.163107+0000","last_fullsized":"2023-11-08T19:49:30.163107+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740735,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67100000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.48699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.61299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740737,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.58699999999999997}]},{"osd":2,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.873},"last":0.67000000000000004}]}]},{"osd":1,"up_from":7,"seq":30064773437,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":1.0309999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:49:38.888 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.888 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.888 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.889 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.890 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.890 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.890 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.891 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.891 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.891 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.892 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.892 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.893 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:38.893 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:49:39.156 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:39.152+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:39.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:39.408+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:39.576 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:39.572+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:40.131 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:40.128+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:40.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:40.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:40.550 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:40.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:41.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:41.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:41.445 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:41.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:41.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:41.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:42.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:42.127+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:42.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:42.491+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:42.557 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:42.551+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:43.107 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:43.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:43.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:43.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:43.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:43.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:44.082 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:44.079+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:44.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:44.451+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:44.523 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:44.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:45.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:45.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:45.441 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:45.435+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:45.500 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:45.495+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:46.149 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:46.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:46.487 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:46.483+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:46.526 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:46.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:47.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:47.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:47.509 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:47.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:47.560 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:47.555+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:48.160 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:48.155+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:48.515 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:48.511+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:48.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:48.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:49.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:49.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:49.491 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:49.487+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:49.497 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:49.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:50.097 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:50.091+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:50.525 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:50.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:50.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:50.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:51.088 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:51.083+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:51.520 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:51.515+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:51.548 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:51.543+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:52.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:52.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:52.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:52.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:52.531 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:52.527+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:53.123 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:53.119+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:53.513 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:53.507+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:53.528 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:53.523+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:54.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:54.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:54.541 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:54.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:54.564 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:54.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:55.151 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:55.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:55.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:55.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:55.529 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:55.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:56.192 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:56.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:56.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:56.567+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:56.577 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:56.571+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:57.174 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:57.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:57.547 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:57.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:57.610 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:57.603+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:58.179 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:58.175+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:58.597 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:58.591+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:58.649 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:58.643+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:58.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:49:59.187 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:49:59.189 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:49:59.199 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6069,"stamp":"2023-11-08T19:49:57.518468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003174"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2167,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:49:50.095297+0000","last_change":"2023-11-08T19:49:50.096269+0000","last_active":"2023-11-08T19:49:50.095297+0000","last_peered":"2023-11-08T19:49:50.095297+0000","last_clean":"2023-11-08T19:49:50.095297+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:49:50.095297+0000","last_undegraded":"2023-11-08T19:49:50.095297+0000","last_fullsized":"2023-11-08T19:49:50.095297+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740739,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.62,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.45400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64000000000000001,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.53500000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:49:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.497,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67100000000000004,"5min":0.752,"15min":0.82399999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.48699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.60299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740741,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.42699999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.67300000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.45000000000000001,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.498}]},{"osd":2,"last update":"Wed Nov 8 19:49:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.72499999999999998,"5min":0.74199999999999999,"15min":0.873},"last":0.57099999999999995}]}]},{"osd":1,"up_from":7,"seq":30064773441,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":1.0309999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:49:59.200 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.201 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.201 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.202 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.202 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.202 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.203 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.203 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.205 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.205 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.206 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.206 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.206 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:49:59.207 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:49:59.208 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:49:59.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:59.479 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:49:59.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:49:59.580 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:49:59.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:49:59.665 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:49:59.659+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:49:59.766 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:49:59.776 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:50:00.057 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:50:00.067 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:50:00.177 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:00.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:00.340 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:50:00.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:50:00.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:00.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:00.626 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:50:00.638 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:50:00.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:00.639+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:00.911 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:50:00.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:50:01.138 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:01.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:01.239 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:50:01.249 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:50:01.526 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:50:01.536 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:50:01.540 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:01.535+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:01.625 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:01.619+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:01.809 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:50:01.819 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:50:02.093 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:50:02.108 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:50:02.119 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:02.115+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:02.392 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:50:02.402 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:50:02.534 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:02.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:02.598 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:02.591+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:02.678 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:50:02.688 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:50:02.959 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:50:02.969 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:50:03.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:03.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:03.578 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:03.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:03.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:03.579+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:04.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:04.103+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:04.549 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:04.543+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:04.565 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:04.559+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:05.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:05.123+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:05.524 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:05.519+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:05.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:05.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:06.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:06.111+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:06.501 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:06.495+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:06.528 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:06.523+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:07.147 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:07.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:07.462 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:07.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:07.531 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:07.527+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:08.182 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:08.179+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:08.507 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:08.503+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:08.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:08.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:09.187 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:09.183+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:09.461 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:09.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:09.585 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:09.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:10.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:10.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:10.412 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:10.407+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:10.584 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:10.579+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:11.137 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:11.131+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:11.436 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:11.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:11.537 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:11.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:12.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:12.139+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:12.483 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:12.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:12.524 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:12.519+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:13.153 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:13.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:13.468 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:13.463+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:13.482 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:13.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:14.158 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:14.151+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:14.454 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:14.447+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:14.487 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:14.483+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:15.191 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:15.187+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:15.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:15.435+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:15.479 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:15.475+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:16.150 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:16.143+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:16.443 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:16.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:16.466 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:16.459+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:17.152 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:17.147+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:17.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:17.455+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:17.495 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:17.491+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:18.178 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:18.171+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:18.419 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:18.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:18.484 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:18.479+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:19.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:19.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:19.405 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:19.399+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:19.535 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:19.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:20.171 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:20.167+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:20.420 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:20.415+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:20.581 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:20.575+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:21.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:21.203+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:21.416 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:21.411+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:21.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:21.531+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:22.167 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:22.163+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:22.437 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:22.431+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:22.515 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:22.511+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:22.971 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:50:23.213 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:23.207+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:23.256 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:50:23.259 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:50:23.268 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6081,"stamp":"2023-11-08T19:50:21.525069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003376"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2181,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:50:18.175600+0000","last_change":"2023-11-08T19:50:18.176624+0000","last_active":"2023-11-08T19:50:18.175600+0000","last_peered":"2023-11-08T19:50:18.175600+0000","last_clean":"2023-11-08T19:50:18.175600+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:50:18.175600+0000","last_undegraded":"2023-11-08T19:50:18.175600+0000","last_fullsized":"2023-11-08T19:50:18.175600+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740744,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68899999999999995,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.82399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.68100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740746,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.627}]},{"osd":2,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.71899999999999997,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.873},"last":0.52700000000000002}]}]},{"osd":1,"up_from":7,"seq":30064773446,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.40500000000000003,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.67300000000000004,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:49:20 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60899999999999999,"15min":0.59799999999999998},"min":{"1min":0.46100000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.72999999999999998,"5min":0.745,"15min":1.0309999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.46800000000000003,"5min":0.443,"15min":0.38100000000000001},"max":{"1min":0.70199999999999996,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:50:23.270 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.271 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.271 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.271 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.272 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.272 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.272 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.273 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.273 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.273 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.274 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.274 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.275 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:23.275 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:50:23.399 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:23.395+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:23.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:23.499+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:24.260 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:24.255+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:24.432 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:24.427+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:24.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:24.451+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:25.243 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:25.239+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:25.445 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:25.439+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:25.482 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:25.479+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:26.219 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:26.215+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:26.446 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:26.439+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:26.479 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:26.475+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:27.248 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:27.242+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:27.433 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:27.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:27.475 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:27.470+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:28.199 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:28.194+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:28.441 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:28.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:28.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:28.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:29.216 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:29.210+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:29.414 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:29.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:29.429 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:29.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:30.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:30.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:30.430 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:30.422+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:30.442 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:30.434+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:31.209 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:31.202+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:31.430 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:31.422+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:31.436 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:31.430+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:32.236 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:32.230+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:32.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:32.378+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:32.389 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:32.382+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:33.230 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:33.222+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:33.365 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:33.358+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:33.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:33.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:34.195 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:34.190+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:34.323 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:34.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:34.412 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:34.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:35.164 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:35.158+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:35.327 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:35.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:35.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:35.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:36.129 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:36.122+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:36.339 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:36.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:36.439 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:36.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:37.121 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:37.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:37.331 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:37.326+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:37.462 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:37.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:38.120 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:38.114+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:38.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:38.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:38.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:38.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:39.118 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:39.110+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:39.326 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:39.322+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:39.539 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:39.534+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:40.086 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:40.082+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:40.310 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:40.306+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:40.511 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:40.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:41.066 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:41.058+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:41.338 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:41.334+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:41.496 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:41.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:42.065 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:42.058+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:42.301 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:42.294+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:42.478 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:42.470+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:43.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:43.066+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:43.276 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:50:43.303 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:43.298+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:43.522 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:43.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:43.557 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:50:43.560 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:50:43.570 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6092,"stamp":"2023-11-08T19:50:43.531087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003205"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2189,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:50:38.117736+0000","last_change":"2023-11-08T19:50:38.118800+0000","last_active":"2023-11-08T19:50:38.117736+0000","last_peered":"2023-11-08T19:50:38.117736+0000","last_clean":"2023-11-08T19:50:38.117736+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:50:38.117736+0000","last_undegraded":"2023-11-08T19:50:38.117736+0000","last_fullsized":"2023-11-08T19:50:38.117736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740748,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68899999999999995,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.82399999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.60299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740750,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.71899999999999997,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.873},"last":0.627}]}]},{"osd":1,"up_from":7,"seq":30064773451,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.30099999999999999},"max":{"1min":0.625,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.71699999999999997,"5min":0.745,"15min":1.0309999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:50:43.572 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.572 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.572 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.573 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.573 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.573 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.574 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.574 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.575 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.576 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.576 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.576 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.577 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:50:43.577 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:50:44.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:44.062+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:44.261 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:44.254+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:44.514 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:44.506+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:45.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:45.026+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:45.307 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:45.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:45.503 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:45.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:46.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:46.010+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:46.347 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:46.342+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:46.507 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:46.502+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:46.990 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:46.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:47.378 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:47.374+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:47.544 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:47.538+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:47.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:47.990+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:48.414 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:48.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:48.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:48.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:49.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:49.002+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:49.370 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:49.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:49.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:49.486+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:49.967 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:49.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:50.324 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:50.318+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:50.452 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:50.446+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:50.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:50.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:51.293 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:51.286+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:51.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:51.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:51.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:51.966+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:52.309 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:52.302+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:52.411 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:52.406+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:52.989 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:52.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:53.354 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:53.346+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:53.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:53.418+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:53.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:53.982+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:54.373 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:54.366+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:54.444 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:54.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:54.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:54.966+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:55.397 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:55.390+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:55.494 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:55.490+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:55.959 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:55.954+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:56.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:56.398+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:56.525 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:56.518+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:56.969 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:56.962+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:57.425 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:57.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:57.533 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:57.526+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:57.924 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:57.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:58.411 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:58.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:58.504 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:58.498+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:58.923 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:58.918+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:59.403 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:50:59.394+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:50:59.465 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:50:59.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:50:59.888 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:50:59.882+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:00.361 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:00.354+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:00.486 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:00.478+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:00.850 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:00.842+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:01.384 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:01.378+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:01.442 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:01.438+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:01.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:01.890+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:02.409 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:02.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:02.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:02.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:02.867 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:02.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:03.459 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:03.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:03.468 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:03.462+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:03.578 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:51:03.826 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:03.818+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:03.865 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:51:03.868 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:51:03.878 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6102,"stamp":"2023-11-08T19:51:03.536454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003262"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2203,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:50:55.957484+0000","last_change":"2023-11-08T19:50:55.958568+0000","last_active":"2023-11-08T19:50:55.957484+0000","last_peered":"2023-11-08T19:50:55.957484+0000","last_clean":"2023-11-08T19:50:55.957484+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:50:55.957484+0000","last_undegraded":"2023-11-08T19:50:55.957484+0000","last_fullsized":"2023-11-08T19:50:55.957484+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740752,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.63700000000000001,"5min":0.65900000000000003,"15min":0.72999999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68899999999999995,"5min":0.75700000000000001,"15min":0.78100000000000003},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Nov 8 19:50:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.49199999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.82399999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63400000000000001,"15min":0.63600000000000001},"min":{"1min":0.51000000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.749,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.63}]}]},{"osd":0,"up_from":8,"seq":34359740754,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.52600000000000002},"min":{"1min":0.42899999999999999,"5min":0.40000000000000002,"15min":0.39100000000000001},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.46400000000000002,"5min":0.44500000000000001,"15min":0.36699999999999999},"max":{"1min":0.68600000000000005,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.46600000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:50:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.71899999999999997,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.502},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61399999999999999,"15min":0.621},"min":{"1min":0.52000000000000002,"5min":0.46300000000000002,"15min":0.44400000000000001},"max":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.873},"last":0.56399999999999995}]}]},{"osd":1,"up_from":7,"seq":30064773455,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.30099999999999999},"max":{"1min":0.625,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.71699999999999997,"5min":0.745,"15min":1.0309999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:51:03.880 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.881 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.881 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.882 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.883 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.884 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.884 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.885 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.886 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.887 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.887 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.887 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.888 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:03.888 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:51:04.421 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:04.414+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:04.461 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:04.454+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:04.784 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:04.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:05.423 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:05.418+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:05.471 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:05.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:05.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:05.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:06.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:06.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:06.440 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:06.434+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:06.720 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:06.714+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:07.408 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:07.402+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:07.474 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:07.466+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:07.767 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:07.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:08.410 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:08.406+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:08.455 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:08.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:08.761 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:08.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:09.417 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:09.410+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:09.463 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:09.458+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:09.759 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:09.754+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:10.457 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:10.450+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:10.460 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:10.454+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:10.803 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:10.798+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:11.432 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:11.426+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:11.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:11.450+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:11.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:11.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:12.406 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:12.398+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:12.465 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:12.458+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:12.831 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:12.826+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:13.395 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:13.390+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:13.473 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:13.466+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:13.852 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:13.846+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:14.352 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:14.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:14.484 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:14.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:14.902 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:14.897+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:15.353 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:15.345+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:15.458 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:15.449+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:15.939 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:15.933+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:16.336 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:16.329+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:16.486 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:16.477+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:16.970 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:16.961+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:17.378 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:17.369+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:17.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:17.517+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:17.983 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:17.977+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:18.423 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:18.417+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:18.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:18.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:18.976 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:18.969+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:19.398 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:19.393+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:19.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:19.545+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:19.999 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:19.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:20.417 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:20.409+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:20.559 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:20.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:21.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:21.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:21.397 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:21.389+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:21.526 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:21.521+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:22.084 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:22.077+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:22.405 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:22.397+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:22.504 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:22.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:23.133 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:23.125+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:23.379 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:23.373+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:23.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:23.529+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:23.889 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:51:24.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:24.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:24.177 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:51:24.180 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:51:24.190 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6112,"stamp":"2023-11-08T19:51:23.541726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003007"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2223,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:51:16.968010+0000","last_change":"2023-11-08T19:51:16.969040+0000","last_active":"2023-11-08T19:51:16.968010+0000","last_peered":"2023-11-08T19:51:16.968010+0000","last_clean":"2023-11-08T19:51:16.968010+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:51:16.968010+0000","last_undegraded":"2023-11-08T19:51:16.968010+0000","last_fullsized":"2023-11-08T19:51:16.968010+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740756,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.47299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.58399999999999996}]},{"osd":1,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39900000000000002},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.82399999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.747}]}]},{"osd":0,"up_from":8,"seq":34359740758,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.59999999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.873},"last":0.67800000000000005}]}]},{"osd":1,"up_from":7,"seq":30064773459,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.30099999999999999},"max":{"1min":0.625,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46899999999999997,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.68100000000000005,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:50:22 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61599999999999999,"15min":0.59799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.71699999999999997,"5min":0.745,"15min":1.0309999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.67300000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:51:24.192 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.193 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.193 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.193 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.194 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.194 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.195 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.195 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.196 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.196 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.197 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.197 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.197 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:24.198 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:51:24.343 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:24.337+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:24.495 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:24.489+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:25.046 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:25.037+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:25.316 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:25.309+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:25.541 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:25.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:26.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:26.009+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:26.268 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:26.265+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:26.567 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:26.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:27.052 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:27.049+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:27.263 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:27.257+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:27.597 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:27.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:28.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:28.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:28.234 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:28.229+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:28.595 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:28.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:29.132 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:29.129+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:29.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:29.221+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:29.594 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:29.593+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:30.176 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:30.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:30.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:30.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:30.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:30.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:31.201 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:31.197+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:31.206 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:31.205+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:31.560 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:31.557+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:32.196 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:32.193+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:32.239 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:32.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:32.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:32.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:33.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:33.169+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:33.195 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:33.193+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:33.546 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:33.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:34.184 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:34.181+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:34.213 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:34.209+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:34.558 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:34.553+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:35.212 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:35.209+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:35.225 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:35.221+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:35.551 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:35.549+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:36.168 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:36.165+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:36.188 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:36.185+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:36.539 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:36.537+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:37.159 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:37.153+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:37.175 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:37.173+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:37.502 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:37.497+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:38.148 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:38.145+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:38.192 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:38.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:38.534 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:38.533+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:39.145 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:39.141+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:39.193 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:39.189+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:39.569 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:39.565+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:40.124 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:40.121+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:40.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:40.169+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:40.576 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:40.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:41.089 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:41.085+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:41.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:41.129+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:41.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:41.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:42.101 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:42.097+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:42.169 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:42.165+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:42.572 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:42.569+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:43.135 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:43.133+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:43.215 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:43.213+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:43.618 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:43.613+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:44.122 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:44.121+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:44.199 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:51:44.243 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:44.241+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:44.482 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:51:44.485 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:51:44.495 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6122,"stamp":"2023-11-08T19:51:43.546944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2239,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:51:36.186377+0000","last_change":"2023-11-08T19:51:36.187548+0000","last_active":"2023-11-08T19:51:36.186377+0000","last_peered":"2023-11-08T19:51:36.186377+0000","last_clean":"2023-11-08T19:51:36.186377+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:51:36.186377+0000","last_undegraded":"2023-11-08T19:51:36.186377+0000","last_fullsized":"2023-11-08T19:51:36.186377+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740760,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.47299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.65600000000000003}]},{"osd":1,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39900000000000002},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.82399999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.57999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740762,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.53000000000000003}]},{"osd":2,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.873},"last":0.60799999999999998}]}]},{"osd":1,"up_from":7,"seq":30064773463,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.42299999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.622},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.48999999999999999,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.60199999999999998,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.98999999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.68799999999999994,"5min":0.72999999999999998,"15min":1.0309999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":1.0700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:51:44.497 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.497 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.497 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.498 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.498 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.499 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.499 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.499 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.500 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.500 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.501 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.501 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.501 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:51:44.502 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:51:44.612 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:44.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:45.096 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:45.093+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:45.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:45.273+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:45.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:45.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:46.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:46.045+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:46.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:46.281+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:46.655 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:46.653+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:47.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:47.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:47.238 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:47.237+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:47.687 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:47.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:48.021 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:48.017+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:48.220 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:48.217+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:48.713 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:48.709+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:49.036 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:49.033+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:49.203 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:49.201+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:49.702 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:49.701+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:49.993 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:49.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:50.178 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:50.173+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:50.688 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:50.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:51.014 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:51.013+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:51.176 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:51.173+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:51.646 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:51.641+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:52.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:52.029+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:52.137 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:52.133+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:52.638 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:52.633+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:53.010 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:53.005+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:53.118 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:53.113+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:53.619 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:53.617+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:53.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:53.989+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:54.109 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:54.105+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:54.577 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:54.573+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:54.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:54.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:55.067 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:55.065+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:55.542 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:55.541+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:56.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:56.001+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:56.022 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:56.017+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:56.583 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:56.581+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:56.960 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:56.957+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:57.037 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:57.033+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:57.614 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:57.609+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:57.968 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:57.965+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:58.017 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:58.013+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:58.652 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:58.649+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:51:58.997 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:51:58.993+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:59.049 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:59.045+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:51:59.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:51:59.689+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:00.000 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:51:59.997+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:00.027 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:00.025+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:00.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:00.685+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:00.973 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:00.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:01.060 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:01.056+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:01.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:01.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:01.991 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:01.988+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:02.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:02.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:02.640 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:02.636+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:02.958 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:02.952+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:03.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:03.068+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:03.645 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:03.640+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:03.966 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:03.960+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:04.108 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:04.104+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:04.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:52:04.689 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:04.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:04.791 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:52:04.794 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:52:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6132,"stamp":"2023-11-08T19:52:03.552323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2251,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:51:56.000099+0000","last_change":"2023-11-08T19:51:56.001129+0000","last_active":"2023-11-08T19:51:56.000099+0000","last_peered":"2023-11-08T19:51:56.000099+0000","last_clean":"2023-11-08T19:51:56.000099+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:51:56.000099+0000","last_undegraded":"2023-11-08T19:51:56.000099+0000","last_fullsized":"2023-11-08T19:51:56.000099+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740764,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.5},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.47299999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71699999999999997,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Nov 8 19:51:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.39900000000000002},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":0.82399999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63600000000000001,"15min":0.63700000000000001},"min":{"1min":0.502,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78400000000000003,"5min":0.95699999999999996,"15min":1.4530000000000001},"last":0.621}]}]},{"osd":0,"up_from":8,"seq":34359740766,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53000000000000003,"15min":0.52500000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.69399999999999995,"5min":0.72499999999999998,"15min":0.75600000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:51:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.46000000000000002,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.61699999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.873},"last":0.68600000000000005}]}]},{"osd":1,"up_from":7,"seq":30064773467,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.52200000000000002},"min":{"1min":0.42299999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.48999999999999999,"5min":0.39600000000000002,"15min":0.34799999999999998},"max":{"1min":0.60199999999999998,"5min":0.71799999999999997,"15min":0.86299999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Nov 8 19:51:25 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.68799999999999994,"5min":0.72999999999999998,"15min":1.0309999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:52:04.805 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.805 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.806 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.806 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.807 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.807 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.807 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.808 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.808 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.808 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.809 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.809 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.809 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:04.810 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-11-08T19:52:04.928 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:04.924+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:05.088 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-11-08T19:52:05.101 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-11-08T19:52:05.117 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:05.112+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:05.380 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-11-08T19:52:05.393 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-11-08T19:52:05.673 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-11-08T19:52:05.682 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-11-08T19:52:05.693 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:05.688+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:05.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:05.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:05.966 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-11-08T19:52:05.977 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-11-08T19:52:06.093 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:06.088+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:06.301 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-11-08T19:52:06.315 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-11-08T19:52:06.586 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-11-08T19:52:06.600 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-11-08T19:52:06.715 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:06.712+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:06.916 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:06.912+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:07.075 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:07.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:07.670 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:07.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:07.718 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-11-08T19:52:07.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-11-08T19:52:07.903 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:07.900+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:08.018 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-11-08T19:52:08.028 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-11-08T19:52:08.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:08.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:08.300 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-11-08T19:52:08.309 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-11-08T19:52:08.588 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-11-08T19:52:08.601 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-11-08T19:52:08.682 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:08.680+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:08.874 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-11-08T19:52:08.883 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-11-08T19:52:08.894 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:08.888+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:09.146 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:09.140+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:09.165 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-11-08T19:52:09.178 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-11-08T19:52:09.461 INFO:teuthology.orchestra.run.smithi196.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-11-08T19:52:09.475 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:52:09.673 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:09.668+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:09.923 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:09.920+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:10.173 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:10.168+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:10.678 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:10.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:10.932 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:10.928+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:11.183 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:11.180+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:11.705 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:11.700+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:11.984 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:11.980+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:12.168 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:12.164+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:12.710 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:12.704+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:13.034 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:13.032+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:13.140 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:13.136+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:13.668 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:13.664+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:14.068 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:14.064+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:14.125 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:14.120+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:14.648 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:14.644+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:15.101 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:15.096+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:15.110 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:15.108+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:15.677 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:15.672+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:16.073 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:16.068+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:16.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:16.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:16.679 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:16.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:17.046 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:17.044+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:17.069 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:17.064+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:17.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:17.724+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:18.016 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:18.012+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:18.095 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:18.092+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:18.690 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:18.684+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:19.045 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:19.040+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:19.102 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:19.096+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:19.701 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:19.696+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:20.001 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:19.996+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:20.080 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:20.076+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:20.681 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:20.676+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:20.973 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:20.968+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:21.126 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:21.124+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:21.686 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:21.680+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:21.951 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:21.948+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:22.083 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:22.080+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:22.733 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:22.728+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:22.910 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:22.908+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:23.090 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:23.084+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:23.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:23.712+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:23.900 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:23.896+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:24.064 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:24.060+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:24.741 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:24.736+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:24.875 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:24.872+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:25.078 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:25.072+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:25.777 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:25.772+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:25.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:25.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:26.041 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:26.036+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:26.812 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:26.808+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:26.834 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:26.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:27.031 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:27.028+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:27.771 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:27.768+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:27.832 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:27.828+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:27.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:27.988+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:28.729 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:28.724+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:28.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:28.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:28.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:28.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:29.477 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:52:29.718 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:29.716+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:29.757 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:29.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:29.767 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:52:29.769 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:52:29.779 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6145,"stamp":"2023-11-08T19:52:29.559388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003243"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2271,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:52:27.990125+0000","last_change":"2023-11-08T19:52:27.991271+0000","last_active":"2023-11-08T19:52:27.990125+0000","last_peered":"2023-11-08T19:52:27.990125+0000","last_clean":"2023-11-08T19:52:27.990125+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:52:27.990125+0000","last_undegraded":"2023-11-08T19:52:27.990125+0000","last_fullsized":"2023-11-08T19:52:27.990125+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740770,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65600000000000003,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.61199999999999999}]},{"osd":1,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71199999999999997,"5min":0.752,"15min":0.82399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.78400000000000003,"15min":1.4530000000000001},"last":0.69999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740772,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.72899999999999998,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.873},"last":0.69199999999999995}]}]},{"osd":1,"up_from":7,"seq":30064773472,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0309999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:52:29.781 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.781 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.782 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.782 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.782 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.783 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.783 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.783 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.784 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.784 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.784 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.785 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.785 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:29.785 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:52:29.952 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:29.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:30.711 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:30.708+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:30.755 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:30.752+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:30.998 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:30.992+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:31.736 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:31.732+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:31.799 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:31.796+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:31.980 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:31.976+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:32.764 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:32.760+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:32.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:32.780+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:33.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:33.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:33.754 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:33.748+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:33.823 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:33.820+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:34.002 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:34.000+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:34.779 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:34.776+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:34.806 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:34.804+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:34.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:34.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:35.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:35.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:35.856 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:35.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:35.945 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:35.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:36.821 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:36.816+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:36.829 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:36.824+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:36.909 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:36.904+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:37.842 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:37.836+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:37.847 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:37.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:37.891 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:37.888+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:38.842 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:38.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:38.852 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:38.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:38.926 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:38.920+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:39.853 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:39.848+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:39.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:39.876+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:39.955 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:39.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:40.848 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:40.844+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:40.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:40.852+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:40.946 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:40.940+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:41.814 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:41.812+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:41.844 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:41.840+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:41.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:41.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:42.786 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:42.784+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:42.813 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:42.808+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:42.954 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:42.952+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:43.752 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:43.748+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:43.804 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:43.800+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:43.961 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:43.956+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:44.755 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:44.752+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:44.806 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:44.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:44.930 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:44.924+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:45.782 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:45.780+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:45.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:45.836+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:45.950 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:45.948+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:46.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:46.804+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:46.832 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:46.828+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:46.979 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:46.976+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:47.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:47.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:47.880 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:47.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:48.003 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:47.999+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:48.852 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:48.847+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:48.890 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:48.883+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:48.995 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:48.991+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:49.787 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:52:49.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:49.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:49.879 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:49.875+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:50.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:50.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:50.073 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:52:50.076 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:52:50.086 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6155,"stamp":"2023-11-08T19:52:49.565040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003215"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2291,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:52:46.977745+0000","last_change":"2023-11-08T19:52:46.978766+0000","last_active":"2023-11-08T19:52:46.977745+0000","last_peered":"2023-11-08T19:52:46.977745+0000","last_clean":"2023-11-08T19:52:46.977745+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:52:46.977745+0000","last_undegraded":"2023-11-08T19:52:46.977745+0000","last_fullsized":"2023-11-08T19:52:46.977745+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740774,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65600000000000003,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.60199999999999998}]},{"osd":1,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71199999999999997,"5min":0.752,"15min":0.82399999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.78400000000000003,"15min":1.4530000000000001},"last":0.68500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740776,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.72899999999999998,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.504}]},{"osd":2,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.873},"last":0.59199999999999997}]}]},{"osd":1,"up_from":7,"seq":30064773476,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0309999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:52:50.088 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.088 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.088 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.089 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.089 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.090 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.090 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.090 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.091 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.091 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.092 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.092 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.092 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:52:50.093 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:52:50.850 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:50.843+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:50.857 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:50.851+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:51.050 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:51.043+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:51.816 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:51.811+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:51.817 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:51.811+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:52.100 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:52.095+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:52.810 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:52.807+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:52.839 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:52.835+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:53.061 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:53.055+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:53.776 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:53.771+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:53.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:53.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:54.074 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:54.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:54.783 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:54.779+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:54.809 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:54.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:55.055 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:55.051+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:55.766 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:55.759+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:55.802 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:55.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:56.033 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:56.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:56.762 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:56.755+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:56.804 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:56.799+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:57.067 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:57.063+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:57.811 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:57.807+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:57.833 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:57.827+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:58.071 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:58.067+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:58.819 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:58.815+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:52:58.855 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:58.851+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:59.032 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:52:59.027+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:59.835 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:52:59.831+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:52:59.838 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:52:59.835+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:00.034 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:00.031+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:00.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:00.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:00.885 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:00.879+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:01.016 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:01.011+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:01.751 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:01.747+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:01.930 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:01.927+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:02.009 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:02.003+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:02.745 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:02.739+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:02.977 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:02.971+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:02.980 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:02.975+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:03.778 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:03.771+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:03.934 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:03.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:04.010 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:04.003+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:04.793 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:04.787+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:04.948 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:04.943+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:05.030 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:05.023+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:05.808 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:05.803+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:05.933 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:05.927+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:06.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:06.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:06.830 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:06.823+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:06.917 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:06.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:07.088 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:07.083+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:07.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:07.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:07.951 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:07.947+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:08.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:08.095+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:08.869 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:08.863+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:08.978 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:08.975+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:09.136 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:09.131+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:09.873 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:09.867+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:09.992 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:09.987+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:10.094 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:53:10.102 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:10.099+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:10.377 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:53:10.379 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:53:10.389 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6165,"stamp":"2023-11-08T19:53:09.570969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003513"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2305,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:53:04.945704+0000","last_change":"2023-11-08T19:53:04.946737+0000","last_active":"2023-11-08T19:53:04.945704+0000","last_peered":"2023-11-08T19:53:04.945704+0000","last_clean":"2023-11-08T19:53:04.945704+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:53:04.945704+0000","last_undegraded":"2023-11-08T19:53:04.945704+0000","last_fullsized":"2023-11-08T19:53:04.945704+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740778,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.41399999999999998,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.45700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.65600000000000003,"5min":0.72299999999999998,"15min":0.78100000000000003},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:52:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71199999999999997,"5min":0.752,"15min":0.82399999999999995},"last":0.748},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.626,"15min":0.63600000000000001},"min":{"1min":0.47499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.78400000000000003,"15min":1.4530000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740780,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53000000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55600000000000005,"15min":0.55900000000000005},"min":{"1min":0.45300000000000001,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.72899999999999998,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Nov 8 19:52:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.42699999999999999},"max":{"1min":0.70699999999999996,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60399999999999998,"15min":0.61599999999999999},"min":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.71899999999999997,"5min":0.72499999999999998,"15min":0.873},"last":0.61799999999999999}]}]},{"osd":1,"up_from":7,"seq":30064773480,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0309999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:53:10.391 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.391 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.392 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.392 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.392 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.393 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.393 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.393 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.394 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.394 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.395 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.395 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.395 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:10.396 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:53:10.879 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:10.875+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:10.987 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:10.983+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:11.124 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:11.119+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:11.926 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:11.919+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:11.973 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:11.967+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:12.117 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:12.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:12.939 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:12.935+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:12.944 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:12.939+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:13.121 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:13.115+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:13.897 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:13.891+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:13.989 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:13.983+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:14.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:14.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:14.866 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:14.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:15.028 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:15.023+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:15.066 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:15.059+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:15.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:15.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:16.052 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:16.047+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:16.054 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:16.051+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:16.886 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:16.883+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:17.047 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:17.043+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:17.078 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:17.075+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:17.849 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:17.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:18.062 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:18.059+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:18.097 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:18.091+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:18.857 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:18.851+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:19.048 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:19.043+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:19.144 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:19.139+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:19.885 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:19.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:20.095 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:20.091+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:20.110 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:20.103+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:20.918 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:20.915+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:21.070 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:21.067+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:21.091 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:21.087+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:21.872 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:21.867+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:22.050 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:22.047+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:22.120 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:22.115+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:22.873 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:22.867+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:23.081 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:23.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:23.172 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:23.167+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:23.833 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:23.827+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:24.080 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:24.075+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:24.223 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:24.219+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:24.861 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:24.855+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:25.071 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:25.067+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:25.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:25.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:25.848 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:25.843+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:26.083 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:26.079+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:26.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:26.255+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:26.841 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:26.835+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:27.115 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:27.111+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:27.272 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:27.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:27.864 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:27.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:28.153 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:28.147+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:28.240 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:28.235+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:28.863 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:28.859+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:29.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:29.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:29.271 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:29.267+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:29.874 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:29.867+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:30.169 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:30.163+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:30.258 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:30.251+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:30.397 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:53:30.690 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:53:30.693 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:53:30.703 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6175,"stamp":"2023-11-08T19:53:29.576588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003305"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2319,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:53:28.860738+0000","last_change":"2023-11-08T19:53:28.861871+0000","last_active":"2023-11-08T19:53:28.860738+0000","last_peered":"2023-11-08T19:53:28.860738+0000","last_clean":"2023-11-08T19:53:28.860738+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:53:28.860738+0000","last_undegraded":"2023-11-08T19:53:28.860738+0000","last_fullsized":"2023-11-08T19:53:28.860738+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740782,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":0.64200000000000002,"5min":0.71699999999999997,"15min":0.78100000000000003},"last":0.50900000000000001}]},{"osd":1,"last update":"Wed Nov 8 19:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.752,"15min":0.82399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.28799999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":1.4530000000000001},"last":0.60399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740784,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.70599999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.5}]},{"osd":2,"last update":"Wed Nov 8 19:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.42699999999999999},"max":{"1min":0.65700000000000003,"5min":0.74299999999999999,"15min":0.75},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.873},"last":0.63600000000000001}]}]},{"osd":1,"up_from":7,"seq":30064773484,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51200000000000001,"15min":0.52300000000000002},"min":{"1min":0.36499999999999999,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.63600000000000001,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Wed Nov 8 19:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.0309999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.61699999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:53:30.705 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.705 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.706 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.706 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.706 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.707 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.707 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.707 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.708 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.708 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.708 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.709 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.709 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:30.710 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-08T19:53:30.915 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:30.911+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:31.162 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:31.155+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:31.283 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:31.279+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:31.907 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:31.903+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:32.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:32.143+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:32.294 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:32.291+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:32.884 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:32.879+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:33.187 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:33.183+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:33.299 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:33.295+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:33.899 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:33.895+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:34.231 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:34.227+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:34.250 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:34.247+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:34.868 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:34.862+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:35.194 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:35.186+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:35.254 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:35.246+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:35.829 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:35.822+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:36.163 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:36.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:36.226 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:36.222+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:36.809 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:36.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:37.180 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:37.174+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:37.262 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:37.254+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:37.763 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:37.758+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:38.195 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:38.190+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:38.275 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:38.270+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:38.782 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:38.778+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:39.208 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:39.202+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:39.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:39.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:39.758 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:39.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:40.166 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:40.158+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:40.207 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:40.202+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:40.768 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:40.762+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:41.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:41.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:41.242 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:41.234+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:41.750 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:41.742+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:42.127 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:42.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:42.225 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:42.218+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:42.754 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:42.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:43.177 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:43.170+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:43.217 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:43.210+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:43.794 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:43.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:44.146 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:44.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:44.184 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:44.178+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:44.815 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:44.810+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:45.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:45.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:45.146 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:45.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:45.800 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:45.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:46.130 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:46.122+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:46.131 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:46.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:46.797 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:46.790+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:47.132 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:47.126+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:47.160 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:47.154+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:47.755 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:47.750+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:48.164 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:48.158+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:48.173 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:48.166+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:48.792 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:48.786+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:49.147 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:49.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:49.147 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:49.142+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:49.808 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:49.802+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:50.150 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:50.142+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:50.182 INFO:tasks.ceph.osd.1.smithi196.stderr:2023-11-08T19:53:50.174+0000 7f0a1b620700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:341 3.2 3:661a17f5:test1::rbd_data.2944a8f8eceb.0000000000000051:head [set-alloc-hint object_size 4194304 write_size 4194304,write 167936~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:50.711 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-08T19:53:50.801 INFO:tasks.ceph.osd.0.smithi196.stderr:2023-11-08T19:53:50.794+0000 7f71e2234700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10567.0:762 3.3 3:f7833ba0:test1::rbd_data.2944a8f8eceb.0000000000000096:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3973120~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e155) 2023-11-08T19:53:50.998 INFO:teuthology.orchestra.run.smithi196.stdout: 2023-11-08T19:53:51.000 INFO:teuthology.orchestra.run.smithi196.stderr:dumped all 2023-11-08T19:53:51.011 INFO:teuthology.orchestra.run.smithi196.stdout:{"pg_ready":true,"pg_map":{"version":6185,"stamp":"2023-11-08T19:53:49.582396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":384384938,"num_objects":367,"num_object_clones":4,"num_object_copies":734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":175,"num_read":65719,"num_read_kb":139748,"num_write":18152,"num_write_kb":8823283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25857,"ondisk_log_size":25857,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1276980,"kb_used_data":352540,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281838540,"statfs":{"total":289910292480,"available":288602664960,"internally_reserved":0,"allocated":361000960,"data_stored":358652463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,1,2,5,515],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003626"},"pg_stats":[{"pgid":"2.7","version":"155'900","reported_seq":1870,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772725+0000","last_change":"2023-11-08T16:38:25.389284+0000","last_active":"2023-11-08T17:36:11.772725+0000","last_peered":"2023-11-08T17:36:11.772725+0000","last_clean":"2023-11-08T17:36:11.772725+0000","last_became_active":"2023-11-08T16:32:50.313908+0000","last_became_peered":"2023-11-08T16:32:50.313908+0000","last_unstale":"2023-11-08T17:36:11.772725+0000","last_undegraded":"2023-11-08T17:36:11.772725+0000","last_fullsized":"2023-11-08T17:36:11.772725+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":900,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19005610,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":751,"num_read_kb":1895,"num_write":774,"num_write_kb":1154353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'855","reported_seq":1730,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773245+0000","last_change":"2023-11-08T16:38:25.388875+0000","last_active":"2023-11-08T17:36:11.773245+0000","last_peered":"2023-11-08T17:36:11.773245+0000","last_clean":"2023-11-08T17:36:11.773245+0000","last_became_active":"2023-11-08T16:32:50.311447+0000","last_became_peered":"2023-11-08T16:32:50.311447+0000","last_unstale":"2023-11-08T17:36:11.773245+0000","last_undegraded":"2023-11-08T17:36:11.773245+0000","last_fullsized":"2023-11-08T17:36:11.773245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":855,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23882229,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":2,"num_read":593,"num_read_kb":2590,"num_write":676,"num_write_kb":1111955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'942","reported_seq":1876,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773391+0000","last_change":"2023-11-08T16:38:25.389452+0000","last_active":"2023-11-08T17:36:11.773391+0000","last_peered":"2023-11-08T17:36:11.773391+0000","last_clean":"2023-11-08T17:36:11.773391+0000","last_became_active":"2023-11-08T16:32:50.311229+0000","last_became_peered":"2023-11-08T16:32:50.311229+0000","last_unstale":"2023-11-08T17:36:11.773391+0000","last_undegraded":"2023-11-08T17:36:11.773391+0000","last_fullsized":"2023-11-08T17:36:11.773391+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":942,"ondisk_log_size":942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48435300,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":676,"num_read_kb":4616,"num_write":801,"num_write_kb":1168271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'803","reported_seq":1662,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772937+0000","last_change":"2023-11-08T16:38:25.384734+0000","last_active":"2023-11-08T17:36:11.772937+0000","last_peered":"2023-11-08T17:36:11.772937+0000","last_clean":"2023-11-08T17:36:11.772937+0000","last_became_active":"2023-11-08T16:32:50.311490+0000","last_became_peered":"2023-11-08T16:32:50.311490+0000","last_unstale":"2023-11-08T17:36:11.772937+0000","last_undegraded":"2023-11-08T17:36:11.772937+0000","last_fullsized":"2023-11-08T17:36:11.772937+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":803,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32075819,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":524,"num_read_kb":2228,"num_write":664,"num_write_kb":997528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"155'4426","reported_seq":12291,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772464+0000","last_change":"2023-11-08T16:38:25.399356+0000","last_active":"2023-11-08T17:36:11.772464+0000","last_peered":"2023-11-08T17:36:11.772464+0000","last_clean":"2023-11-08T17:36:11.772464+0000","last_became_active":"2023-11-08T16:32:56.391398+0000","last_became_peered":"2023-11-08T16:32:56.391398+0000","last_unstale":"2023-11-08T17:36:11.772464+0000","last_undegraded":"2023-11-08T17:36:11.772464+0000","last_fullsized":"2023-11-08T17:36:11.772464+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":4426,"ondisk_log_size":4426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19101086,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":44,"num_read":14953,"num_read_kb":17245,"num_write":2941,"num_write_kb":1755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":1438,"num_flush":228,"num_flush_kb":1811,"num_evict":486,"num_evict_kb":20157,"num_promote":536,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'795","reported_seq":2331,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-11-08T19:53:46.794899+0000","last_change":"2023-11-08T19:53:46.795804+0000","last_active":"2023-11-08T19:53:46.794899+0000","last_peered":"2023-11-08T19:53:46.794899+0000","last_clean":"2023-11-08T19:53:46.794899+0000","last_became_active":"2023-11-08T16:32:50.310983+0000","last_became_peered":"2023-11-08T16:32:50.310983+0000","last_unstale":"2023-11-08T19:53:46.794899+0000","last_undegraded":"2023-11-08T19:53:46.794899+0000","last_fullsized":"2023-11-08T19:53:46.794899+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":795,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25407697,"num_objects":19,"num_object_clones":1,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":734,"num_read_kb":1553,"num_write":667,"num_write_kb":1092651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"155'6123","reported_seq":12207,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771965+0000","last_change":"2023-11-08T16:38:25.389125+0000","last_active":"2023-11-08T17:36:11.771965+0000","last_peered":"2023-11-08T17:36:11.771965+0000","last_clean":"2023-11-08T17:36:11.771965+0000","last_became_active":"2023-11-08T16:32:56.391504+0000","last_became_peered":"2023-11-08T16:32:56.391504+0000","last_unstale":"2023-11-08T17:36:11.771965+0000","last_undegraded":"2023-11-08T17:36:11.771965+0000","last_fullsized":"2023-11-08T17:36:11.771965+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":6123,"ondisk_log_size":6123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23168096,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":43,"num_read":19134,"num_read_kb":16269,"num_write":5098,"num_write_kb":3546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1120,"num_flush":240,"num_flush_kb":5427,"num_evict":582,"num_evict_kb":27811,"num_promote":641,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'1019","reported_seq":1943,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.771736+0000","last_change":"2023-11-08T16:38:25.379200+0000","last_active":"2023-11-08T17:36:11.771736+0000","last_peered":"2023-11-08T17:36:11.771736+0000","last_clean":"2023-11-08T17:36:11.771736+0000","last_became_active":"2023-11-08T16:32:50.309194+0000","last_became_peered":"2023-11-08T16:32:50.309194+0000","last_unstale":"2023-11-08T17:36:11.771736+0000","last_undegraded":"2023-11-08T17:36:11.771736+0000","last_fullsized":"2023-11-08T17:36:11.771736+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1019,"ondisk_log_size":1019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115724553,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":643,"num_read_kb":1044,"num_write":876,"num_write_kb":1035771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"155'3543","reported_seq":9847,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772172+0000","last_change":"2023-11-08T16:38:25.399255+0000","last_active":"2023-11-08T17:36:11.772172+0000","last_peered":"2023-11-08T17:36:11.772172+0000","last_clean":"2023-11-08T17:36:11.772172+0000","last_became_active":"2023-11-08T16:32:56.391173+0000","last_became_peered":"2023-11-08T16:32:56.391173+0000","last_unstale":"2023-11-08T17:36:11.772172+0000","last_undegraded":"2023-11-08T17:36:11.772172+0000","last_fullsized":"2023-11-08T17:36:11.772172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3543,"ondisk_log_size":3543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":23368543,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":40,"num_read":14549,"num_read_kb":41293,"num_write":1986,"num_write_kb":1129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":863,"num_flush":200,"num_flush_kb":17,"num_evict":557,"num_evict_kb":38225,"num_promote":603,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1306","reported_seq":2216,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-11-08T19:39:54.549205+0000","last_change":"2023-11-08T19:39:54.549205+0000","last_active":"2023-11-08T19:39:54.549205+0000","last_peered":"2023-11-08T19:39:54.549205+0000","last_clean":"2023-11-08T19:39:54.549205+0000","last_became_active":"2023-11-08T16:32:50.312423+0000","last_became_peered":"2023-11-08T16:32:50.312423+0000","last_unstale":"2023-11-08T19:39:54.549205+0000","last_undegraded":"2023-11-08T19:39:54.549205+0000","last_fullsized":"2023-11-08T19:39:54.549205+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1306,"ondisk_log_size":1306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17404449,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":584,"num_read_kb":6333,"num_write":729,"num_write_kb":1123903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3825","reported_seq":9675,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772504+0000","last_change":"2023-11-08T16:38:25.388628+0000","last_active":"2023-11-08T17:36:11.772504+0000","last_peered":"2023-11-08T17:36:11.772504+0000","last_clean":"2023-11-08T17:36:11.772504+0000","last_became_active":"2023-11-08T16:32:56.391607+0000","last_became_peered":"2023-11-08T16:32:56.391607+0000","last_unstale":"2023-11-08T17:36:11.772504+0000","last_undegraded":"2023-11-08T17:36:11.772504+0000","last_fullsized":"2023-11-08T17:36:11.772504+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:55.320022+0000","last_clean_scrub_stamp":"2023-11-08T16:32:55.320022+0000","log_size":3825,"ondisk_log_size":3825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11748621,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":44,"num_read":11761,"num_read_kb":44029,"num_write":2214,"num_write_kb":1262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1160,"num_flush":156,"num_flush_kb":26,"num_evict":597,"num_evict_kb":42412,"num_promote":654,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"155'1320","reported_seq":2324,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.772529+0000","last_change":"2023-11-08T16:38:25.384644+0000","last_active":"2023-11-08T17:36:11.772529+0000","last_peered":"2023-11-08T17:36:11.772529+0000","last_clean":"2023-11-08T17:36:11.772529+0000","last_became_active":"2023-11-08T16:32:50.308558+0000","last_became_peered":"2023-11-08T16:32:50.308558+0000","last_unstale":"2023-11-08T17:36:11.772529+0000","last_undegraded":"2023-11-08T17:36:11.772529+0000","last_fullsized":"2023-11-08T17:36:11.772529+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":1320,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25062935,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":817,"num_read_kb":653,"num_write":726,"num_write_kb":1131159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-11-08T17:36:11.773620+0000","last_change":"2023-11-08T16:32:50.310519+0000","last_active":"2023-11-08T17:36:11.773620+0000","last_peered":"2023-11-08T17:36:11.773620+0000","last_clean":"2023-11-08T17:36:11.773620+0000","last_became_active":"2023-11-08T16:32:50.310160+0000","last_became_peered":"2023-11-08T16:32:50.310160+0000","last_unstale":"2023-11-08T17:36:11.773620+0000","last_undegraded":"2023-11-08T17:36:11.773620+0000","last_fullsized":"2023-11-08T17:36:11.773620+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-08T16:32:49.273485+0000","last_clean_scrub_stamp":"2023-11-08T16:32:49.273485+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":77386346,"num_objects":218,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":171,"num_read":60397,"num_read_kb":118836,"num_write":12239,"num_write_kb":7692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":19,"num_bytes_hit_set_archive":4581,"num_flush":824,"num_flush_kb":7281,"num_evict":2222,"num_evict_kb":128605,"num_promote":2434,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":3,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97558528,"data_stored":97387732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17917,"ondisk_log_size":17917,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":306998592,"num_objects":149,"num_object_clones":4,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":4,"num_read":5322,"num_read_kb":20912,"num_write":5913,"num_write_kb":8815591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":259465216,"data_stored":259185280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7940,"ondisk_log_size":7940,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740786,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":381816,"kb_used_data":84592,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93990024,"statfs":{"total":96636764160,"available":96245784576,"internally_reserved":0,"allocated":86622208,"data_stored":85829806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,1,0,1,1,2,5,3],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.34799999999999998},"max":{"1min":0.67400000000000004,"5min":0.70199999999999996,"15min":0.72999999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.38100000000000001},"max":{"1min":0.64200000000000002,"5min":0.71699999999999997,"15min":0.78100000000000003},"last":0.56899999999999995}]},{"osd":1,"last update":"Wed Nov 8 19:53:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.53300000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.748,"5min":0.752,"15min":0.82399999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.63,"15min":0.63700000000000001},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.28799999999999998},"max":{"1min":0.74399999999999999,"5min":0.78400000000000003,"15min":1.4530000000000001},"last":0.66000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740788,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438108,"kb_used_data":124500,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93933732,"statfs":{"total":96636764160,"available":96188141568,"internally_reserved":0,"allocated":127488000,"data_stored":126756305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 8 19:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39100000000000001},"max":{"1min":0.70599999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.437},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.44900000000000001,"5min":0.42099999999999999,"15min":0.36699999999999999},"max":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.92400000000000004},"last":0.51500000000000001}]},{"osd":2,"last update":"Wed Nov 8 19:53:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.503,"5min":0.46000000000000002,"15min":0.42699999999999999},"max":{"1min":0.65700000000000003,"5min":0.74299999999999999,"15min":0.75},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60199999999999998,"15min":0.61599999999999999},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.44400000000000001},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.873},"last":0.82499999999999996}]}]},{"osd":1,"up_from":7,"seq":30064773488,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":457056,"kb_used_data":143448,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":93914784,"statfs":{"total":96636764160,"available":96168738816,"internally_reserved":0,"allocated":146890752,"data_stored":146066352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 8 19:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.50900000000000001,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.308},"max":{"1min":0.63400000000000001,"5min":0.70399999999999996,"15min":0.71699999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.39400000000000002,"15min":0.34799999999999998},"max":{"1min":0.63300000000000001,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.495}]},{"osd":2,"last update":"Wed Nov 8 19:53:28 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.60499999999999998},"min":{"1min":0.55400000000000005,"5min":0.41999999999999998,"15min":0.38900000000000001},"max":{"1min":0.70299999999999996,"5min":0.91700000000000004,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.60199999999999998},"min":{"1min":0.54600000000000004,"5min":0.441,"15min":0.38100000000000001},"max":{"1min":0.77500000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93216768,"data_stored":93150207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129732608,"data_stored":129592640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36515840,"data_stored":36442433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32948224,"data_stored":32913661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15831040,"data_stored":15780205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":48779264,"data_stored":48693866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-08T19:53:51.012 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.013 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.013 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.014 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.014 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.014 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.015 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.015 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.016 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.016 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.016 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-11-08T16:32:55.320022+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=55, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.017 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.017 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-08T16:32:49.273485+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=16, tm_min=32, tm_sec=49, tm_wday=2, tm_yday=312, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=8, tm_hour=19, tm_min=35, tm_sec=53, tm_wday=2, tm_yday=312, tm_isdst=0) 2023-11-08T19:53:51.017 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-11-08T19:53:51.027 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-08T19:53:51.027 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-08T19:53:51.028 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-08T19:53:51.029 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:53:51.109 INFO:tasks.ceph.osd.0:Stopped 2023-11-08T19:53:51.110 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-08T19:53:51.110 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:53:51.116 INFO:tasks.ceph.osd.2.smithi196.stderr:2023-11-08T19:53:51.110+0000 7f040a32f700 -1 osd.2 158 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.7:9303 2.0 2:0a482958:test1::rbd_data.2944a8f8eceb.000000000000003d:head [copy-from ver 6118 in=81b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected e155) 2023-11-08T19:53:51.199 INFO:tasks.ceph.osd.1:Stopped 2023-11-08T19:53:51.199 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-08T19:53:51.200 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:53:51.291 INFO:tasks.ceph.osd.2:Stopped 2023-11-08T19:53:51.292 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-08T19:53:51.293 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-08T19:53:51.293 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:53:51.321 INFO:tasks.ceph.mgr.x:Stopped 2023-11-08T19:53:51.322 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-08T19:53:51.323 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-08T19:53:51.323 INFO:teuthology.orchestra.run:waiting for 300 2023-11-08T19:53:51.407 INFO:tasks.ceph.mon.a:Stopped 2023-11-08T19:53:51.408 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-08T19:53:51.409 DEBUG:teuthology.orchestra.run.smithi196:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-11-08T19:53:51.428 INFO:teuthology.orchestra.run.smithi196.stdout:2023-11-08T16:39:16.635290+0000 osd.0 (osd.0) 3 : cluster [WRN] 68 slow requests (by type [ 'reached pg' : 68 ] most affected pool [ 'cache' : 68 ]) 2023-11-08T19:53:51.430 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-11-08T19:53:51.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T19:53:51.431 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-08T19:53:51.747 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T19:53:51.748 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-08T19:53:51.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T19:53:51.983 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-08T19:53:52.170 INFO:tasks.ceph:Archiving mon data... 2023-11-08T19:53:52.172 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000/data/mon.a.tgz 2023-11-08T19:53:52.173 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2023-11-08T19:53:52.179 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.JlToEeLYT6 2023-11-08T19:53:52.179 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JlToEeLYT6 2023-11-08T19:53:52.411 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.JlToEeLYT6 2023-11-08T19:53:52.481 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.JlToEeLYT6 is 617KB 2023-11-08T19:53:52.549 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.JlToEeLYT6 2023-11-08T19:53:52.556 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-08T19:53:52.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-08T19:53:52.571 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-08T19:53:52.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-08T19:53:52.598 INFO:teuthology.orchestra.run.smithi196.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-08T19:53:52.605 INFO:tasks.ceph:Archiving crash dumps... 2023-11-08T19:53:52.607 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000/remote/smithi196/crash 2023-11-08T19:53:52.608 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-08T19:53:52.660 INFO:tasks.ceph:Compressing logs... 2023-11-08T19:53:52.661 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-08T19:53:52.679 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2023-11-08T19:53:52.679 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77364.log 2023-11-08T19:53:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2023-11-08T19:53:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53972.log 2023-11-08T19:53:52.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72697.log 2023-11-08T19:53:52.683 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77364.log.gz 2023-11-08T19:53:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68539.log 2023-11-08T19:53:52.683 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53972.log.gz 2023-11-08T19:53:52.684 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2023-11-08T19:53:52.684 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72697.log.gz 2023-11-08T19:53:52.684 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80629.log 2023-11-08T19:53:52.685 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68539.log.gz 2023-11-08T19:53:52.685 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2023-11-08T19:53:52.685 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2023-11-08T19:53:52.691 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80629.log.gz 2023-11-08T19:53:52.692 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39701.log 2023-11-08T19:53:52.692 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57861.log 2023-11-08T19:53:52.692 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2023-11-08T19:53:52.693 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39701.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39701.log.gz 2023-11-08T19:53:52.693 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76122.log 2023-11-08T19:53:52.693 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2023-11-08T19:53:52.694 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57861.log: 26.5% -- replaced with /var/log/ceph/ceph-client.admin.57861.log.gz 2023-11-08T19:53:52.694 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48726.log 2023-11-08T19:53:52.694 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44482.log: /var/log/ceph/ceph-client.admin.76122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2023-11-08T19:53:52.695 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64293.log 2023-11-08T19:53:52.695 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76122.log.gz 2023-11-08T19:53:52.695 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48726.log.gz 2023-11-08T19:53:52.696 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71598.log 2023-11-08T19:53:52.696 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2023-11-08T19:53:52.696 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64293.log.gz 2023-11-08T19:53:52.697 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57796.log 2023-11-08T19:53:52.697 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71598.log.gz 2023-11-08T19:53:52.697 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75854.log 2023-11-08T19:53:52.698 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2023-11-08T19:53:52.698 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2023-11-08T19:53:52.698 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57796.log.gz 2023-11-08T19:53:52.699 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61965.log 2023-11-08T19:53:52.699 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75854.log.gz 2023-11-08T19:53:52.700 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2023-11-08T19:53:52.700 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44661.log: /var/log/ceph/ceph-client.admin.61965.log: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2023-11-08T19:53:52.700 INFO:teuthology.orchestra.run.smithi196.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.61965.log.gz 2023-11-08T19:53:52.700 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75489.log 2023-11-08T19:53:52.701 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64078.log 2023-11-08T19:53:52.701 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2023-11-08T19:53:52.701 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51120.log 2023-11-08T19:53:52.702 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75489.log: gzip /var/log/ceph/ceph-client.admin.64078.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51645.log 2023-11-08T19:53:52.702 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75489.log.gz 2023-11-08T19:53:52.702 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64078.log.gz 2023-11-08T19:53:52.703 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51120.log.gz 2023-11-08T19:53:52.703 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2023-11-08T19:53:52.753 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79791.log 2023-11-08T19:53:52.754 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51645.log.gz 2023-11-08T19:53:52.754 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75814.log 2023-11-08T19:53:52.754 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35062.log: 0.0%/var/log/ceph/ceph-client.admin.79791.log: -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2023-11-08T19:53:52.755 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2023-11-08T19:53:52.755 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79791.log.gz 2023-11-08T19:53:52.755 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.75814.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51562.log 2023-11-08T19:53:52.756 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75814.log.gz 2023-11-08T19:53:52.756 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63691.log 2023-11-08T19:53:52.756 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2023-11-08T19:53:52.757 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79629.log 2023-11-08T19:53:52.757 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.51562.log.gz 2023-11-08T19:53:52.757 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2023-11-08T19:53:52.758 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63691.log.gz 2023-11-08T19:53:52.758 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72590.log 2023-11-08T19:53:52.758 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79629.log.gz 2023-11-08T19:53:52.759 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log 2023-11-08T19:53:52.759 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2023-11-08T19:53:52.759 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76552.log 2023-11-08T19:53:52.760 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72590.log.gz 2023-11-08T19:53:52.760 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39174.log: /var/log/ceph/ceph-client.admin.65294.log 2023-11-08T19:53:52.760 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39174.log.gz 2023-11-08T19:53:52.761 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74730.log 2023-11-08T19:53:52.761 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76552.log.gz 2023-11-08T19:53:52.761 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80737.log 2023-11-08T19:53:52.762 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65294.log.gz 2023-11-08T19:53:52.762 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.74730.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36701.log 2023-11-08T19:53:52.762 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74730.log.gz 2023-11-08T19:53:52.762 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63606.log 2023-11-08T19:53:52.763 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80737.log.gz 2023-11-08T19:53:52.763 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71875.log 2023-11-08T19:53:52.763 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36701.log.gz 2023-11-08T19:53:52.764 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33020.log 2023-11-08T19:53:52.764 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63606.log.gz 2023-11-08T19:53:52.764 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49719.log 2023-11-08T19:53:52.765 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71875.log.gz 2023-11-08T19:53:52.765 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50922.log 2023-11-08T19:53:52.765 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33020.log.gz 2023-11-08T19:53:52.766 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2023-11-08T19:53:52.766 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49719.log.gz 2023-11-08T19:53:52.766 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-11-08T19:53:52.767 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50922.log.gz 2023-11-08T19:53:52.767 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2023-11-08T19:53:52.767 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2023-11-08T19:53:52.768 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74171.log 2023-11-08T19:53:52.768 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-11-08T19:53:52.768 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60537.log 2023-11-08T19:53:52.769 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2023-11-08T19:53:52.769 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.74171.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40806.log 2023-11-08T19:53:52.769 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74171.log.gz 2023-11-08T19:53:52.770 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73677.log 2023-11-08T19:53:52.770 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60537.log.gz 2023-11-08T19:53:52.770 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49946.log 2023-11-08T19:53:52.771 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40806.log.gz 2023-11-08T19:53:52.771 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59657.log 2023-11-08T19:53:52.771 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73677.log.gz 2023-11-08T19:53:52.772 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49946.log.gzgzip 2023-11-08T19:53:52.772 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.71483.log 2023-11-08T19:53:52.772 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2023-11-08T19:53:52.773 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59657.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.59657.log.gz 2023-11-08T19:53:52.773 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39361.log 2023-11-08T19:53:52.773 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71483.log.gz 2023-11-08T19:53:52.773 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63207.log 2023-11-08T19:53:52.774 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2023-11-08T19:53:52.774 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71012.log 2023-11-08T19:53:52.774 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39361.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39361.log.gz 2023-11-08T19:53:52.775 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63207.log.gz 2023-11-08T19:53:52.775 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2023-11-08T19:53:52.775 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51461.log 2023-11-08T19:53:52.776 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71012.log.gz 2023-11-08T19:53:52.776 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54423.log 2023-11-08T19:53:52.776 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2023-11-08T19:53:52.777 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2023-11-08T19:53:52.777 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51461.log.gz 2023-11-08T19:53:52.777 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54423.log.gz 2023-11-08T19:53:52.778 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69493.log 2023-11-08T19:53:52.778 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log 2023-11-08T19:53:52.778 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2023-11-08T19:53:52.779 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2023-11-08T19:53:52.779 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2023-11-08T19:53:52.779 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69493.log.gz 2023-11-08T19:53:52.780 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46768.log 2023-11-08T19:53:52.780 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gz 2023-11-08T19:53:52.780 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2023-11-08T19:53:52.781 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53103.log 2023-11-08T19:53:52.781 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2023-11-08T19:53:52.781 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79004.log 2023-11-08T19:53:52.782 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46768.log.gz 2023-11-08T19:53:52.782 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73999.log 2023-11-08T19:53:52.782 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53103.log.gz 2023-11-08T19:53:52.783 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38321.log 2023-11-08T19:53:52.783 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79004.log.gz 2023-11-08T19:53:52.783 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73999.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66124.log 2023-11-08T19:53:52.784 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73999.log.gz 2023-11-08T19:53:52.784 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63416.log 2023-11-08T19:53:52.784 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38321.log.gz 2023-11-08T19:53:52.785 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38487.log 2023-11-08T19:53:52.785 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66124.log.gz 2023-11-08T19:53:52.785 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67883.log 2023-11-08T19:53:52.786 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63416.log.gz 2023-11-08T19:53:52.786 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65659.log 2023-11-08T19:53:52.786 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38487.log.gz 2023-11-08T19:53:52.787 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69452.log 2023-11-08T19:53:52.787 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67883.log.gz 2023-11-08T19:53:52.788 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70877.log 2023-11-08T19:53:52.788 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65659.log.gz 2023-11-08T19:53:52.788 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57839.log 2023-11-08T19:53:52.789 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69452.log.gz 2023-11-08T19:53:52.789 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2023-11-08T19:53:52.789 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70877.log.gz 2023-11-08T19:53:52.790 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79845.log /var/log/ceph/ceph-client.admin.57839.log: 2023-11-08T19:53:52.790 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57839.log.gz 2023-11-08T19:53:52.790 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34355.log 2023-11-08T19:53:52.791 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2023-11-08T19:53:52.791 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49986.log 2023-11-08T19:53:52.791 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79845.log.gz 2023-11-08T19:53:52.792 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64680.log 2023-11-08T19:53:52.792 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2023-11-08T19:53:52.792 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40551.log 2023-11-08T19:53:52.793 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49986.log.gz 2023-11-08T19:53:52.793 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64099.log 2023-11-08T19:53:52.793 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52716.log /var/log/ceph/ceph-client.admin.40551.log: 2023-11-08T19:53:52.794 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64680.log.gz 2023-11-08T19:53:52.794 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40551.log.gz 2023-11-08T19:53:52.797 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62030.log 2023-11-08T19:53:52.797 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64099.log.gz 2023-11-08T19:53:52.798 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.52716.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60040.log 2023-11-08T19:53:52.798 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52716.log.gz 2023-11-08T19:53:52.798 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62869.log 2023-11-08T19:53:52.799 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62030.log.gz 2023-11-08T19:53:52.799 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.60040.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2023-11-08T19:53:52.799 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60040.log.gz 2023-11-08T19:53:52.800 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58205.log 2023-11-08T19:53:52.800 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62869.log.gz 2023-11-08T19:53:52.800 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2023-11-08T19:53:52.801 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2023-11-08T19:53:52.801 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76830.log 2023-11-08T19:53:52.801 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58205.log.gz 2023-11-08T19:53:52.802 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69318.log 2023-11-08T19:53:52.802 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2023-11-08T19:53:52.802 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74343.log 2023-11-08T19:53:52.803 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76830.log.gz 2023-11-08T19:53:52.803 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66603.log 2023-11-08T19:53:52.803 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69318.log.gz 2023-11-08T19:53:52.804 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2023-11-08T19:53:52.804 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74343.log.gz 2023-11-08T19:53:52.804 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77106.log 2023-11-08T19:53:52.805 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66603.log.gz 2023-11-08T19:53:52.805 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44703.log 2023-11-08T19:53:52.805 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2023-11-08T19:53:52.806 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56239.log 2023-11-08T19:53:52.806 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77106.log.gz 2023-11-08T19:53:52.806 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.44703.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62762.log 2023-11-08T19:53:52.807 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44703.log.gz 2023-11-08T19:53:52.807 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2023-11-08T19:53:52.807 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56239.log.gz 2023-11-08T19:53:52.808 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62762.log.gz 2023-11-08T19:53:52.808 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55077.log 2023-11-08T19:53:52.808 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35801.log 2023-11-08T19:53:52.809 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2023-11-08T19:53:52.809 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64522.log 2023-11-08T19:53:52.809 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55077.log.gz 2023-11-08T19:53:52.810 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35801.log.gz 2023-11-08T19:53:52.810 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56540.log 2023-11-08T19:53:52.810 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38130.log 2023-11-08T19:53:52.811 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64522.log.gz 2023-11-08T19:53:52.811 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33852.log 2023-11-08T19:53:52.811 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56540.log.gz 2023-11-08T19:53:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57122.log 2023-11-08T19:53:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38130.log.gz 2023-11-08T19:53:52.812 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.33852.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34024.log 2023-11-08T19:53:52.813 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33852.log.gz 2023-11-08T19:53:52.813 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77128.log 2023-11-08T19:53:52.813 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57122.log.gz 2023-11-08T19:53:52.814 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66378.log 2023-11-08T19:53:52.814 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34024.log.gz 2023-11-08T19:53:52.814 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34175.log 2023-11-08T19:53:52.815 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77128.log.gz 2023-11-08T19:53:52.815 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73656.log 2023-11-08T19:53:52.815 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66378.log.gz 2023-11-08T19:53:52.816 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34175.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-08T19:53:52.816 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34175.log.gz 2023-11-08T19:53:52.816 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51545.log 2023-11-08T19:53:52.817 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73656.log.gz 2023-11-08T19:53:52.817 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53232.log 2023-11-08T19:53:52.817 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70759.log 2023-11-08T19:53:52.818 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51545.log: /var/log/ceph/ceph-client.admin.53232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51545.log.gz 2023-11-08T19:53:52.818 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71366.log 2023-11-08T19:53:52.818 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53232.log.gz 2023-11-08T19:53:52.819 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51282.log 2023-11-08T19:53:52.819 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70759.log.gz 2023-11-08T19:53:52.819 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61518.log 2023-11-08T19:53:52.820 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71366.log.gz 2023-11-08T19:53:52.820 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54402.log 2023-11-08T19:53:52.820 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51282.log: /var/log/ceph/ceph-client.admin.61518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2023-11-08T19:53:52.821 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.51282.log.gz 2023-11-08T19:53:52.821 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61518.log.gz 2023-11-08T19:53:52.821 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54402.log.gz 2023-11-08T19:53:52.822 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2023-11-08T19:53:52.822 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61004.log 2023-11-08T19:53:52.822 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45501.log: /var/log/ceph/ceph-client.admin.49177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70275.log 2023-11-08T19:53:52.823 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2023-11-08T19:53:52.823 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2023-11-08T19:53:52.823 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78061.log 2023-11-08T19:53:52.824 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61004.log.gz 2023-11-08T19:53:52.824 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65530.log 2023-11-08T19:53:52.824 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70275.log.gz 2023-11-08T19:53:52.824 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2023-11-08T19:53:52.825 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78061.log: /var/log/ceph/ceph-client.admin.65530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78061.log.gz 2023-11-08T19:53:52.825 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65530.log.gz 2023-11-08T19:53:52.825 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37959.log 2023-11-08T19:53:52.825 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2023-11-08T19:53:52.826 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2023-11-08T19:53:52.826 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2023-11-08T19:53:52.826 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37959.log.gz 2023-11-08T19:53:52.827 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2023-11-08T19:53:52.827 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2023-11-08T19:53:52.827 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56390.log 2023-11-08T19:53:52.827 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2023-11-08T19:53:52.828 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59782.log 2023-11-08T19:53:52.828 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49517.log: /var/log/ceph/ceph-client.admin.56390.log: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 2023-11-08T19:53:52.828 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56390.log.gz 2023-11-08T19:53:52.829 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55668.log 2023-11-08T19:53:52.829 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61151.log 2023-11-08T19:53:52.829 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59782.log.gz 2023-11-08T19:53:52.829 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57649.log 2023-11-08T19:53:52.830 INFO:teuthology.orchestra.run.smithi196.stderr: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.55668.log.gz 2023-11-08T19:53:52.830 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35080.log 2023-11-08T19:53:52.830 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61151.log.gz 2023-11-08T19:53:52.831 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71348.log 2023-11-08T19:53:52.831 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57649.log.gz 2023-11-08T19:53:52.831 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69202.log 2023-11-08T19:53:52.831 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35080.log.gz 2023-11-08T19:53:52.832 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69431.log 2023-11-08T19:53:52.832 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71348.log.gz 2023-11-08T19:53:52.832 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39684.log 2023-11-08T19:53:52.832 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69202.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.69202.log.gz 2023-11-08T19:53:52.833 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.73286.log 2023-11-08T19:53:52.833 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69431.log.gz 2023-11-08T19:53:52.833 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2023-11-08T19:53:52.834 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39684.log.gz 2023-11-08T19:53:52.834 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51745.log 2023-11-08T19:53:52.834 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73286.log.gz 2023-11-08T19:53:52.834 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2023-11-08T19:53:52.835 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2023-11-08T19:53:52.835 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.51745.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64582.log 2023-11-08T19:53:52.835 INFO:teuthology.orchestra.run.smithi196.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.51745.log.gz 2023-11-08T19:53:52.835 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68465.log 2023-11-08T19:53:52.836 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2023-11-08T19:53:52.836 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44363.log 2023-11-08T19:53:52.836 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64582.log.gz 2023-11-08T19:53:52.837 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48103.log 2023-11-08T19:53:52.837 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68465.log.gz 2023-11-08T19:53:52.837 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45522.log 2023-11-08T19:53:52.837 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44363.log.gz 2023-11-08T19:53:52.838 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2023-11-08T19:53:52.838 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48103.log.gz 2023-11-08T19:53:52.838 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50626.log 2023-11-08T19:53:52.838 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45522.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45522.log.gz 2023-11-08T19:53:52.839 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75281.log 2023-11-08T19:53:52.839 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2023-11-08T19:53:52.839 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49905.log 2023-11-08T19:53:52.839 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50626.log.gz 2023-11-08T19:53:52.840 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52068.log 2023-11-08T19:53:52.840 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75281.log.gz 2023-11-08T19:53:52.840 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72482.log 2023-11-08T19:53:52.841 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63798.log 2023-11-08T19:53:52.841 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49905.log.gz 2023-11-08T19:53:52.841 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52068.log.gz 2023-11-08T19:53:52.841 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65638.log 2023-11-08T19:53:52.842 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72482.log.gz 2023-11-08T19:53:52.842 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34644.log 2023-11-08T19:53:52.842 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63798.log.gz 2023-11-08T19:53:52.843 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.65638.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2023-11-08T19:53:52.843 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65638.log.gz 2023-11-08T19:53:52.843 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2023-11-08T19:53:52.843 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34644.log: gzip -5 --verbose -- 1.2%/var/log/ceph/ceph-client.admin.38444.log 2023-11-08T19:53:52.844 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34644.log.gz 2023-11-08T19:53:52.844 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2023-11-08T19:53:52.844 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40313.log 2023-11-08T19:53:52.844 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2023-11-08T19:53:52.845 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66523.log /var/log/ceph/ceph-client.admin.38444.log: 2023-11-08T19:53:52.845 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2023-11-08T19:53:52.845 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44057.log 2023-11-08T19:53:52.845 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40313.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40313.log.gz 2023-11-08T19:53:52.846 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.66523.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76208.log 2023-11-08T19:53:52.846 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66523.log.gz 2023-11-08T19:53:52.846 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2023-11-08T19:53:52.847 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44057.log.gz 2023-11-08T19:53:52.847 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2023-11-08T19:53:52.847 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76208.log.gz 2023-11-08T19:53:52.847 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66166.log 2023-11-08T19:53:52.848 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2023-11-08T19:53:52.848 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57968.log 2023-11-08T19:53:52.848 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2023-11-08T19:53:52.848 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53873.log 2023-11-08T19:53:52.849 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66166.log.gz 2023-11-08T19:53:52.849 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57968.log.gz 2023-11-08T19:53:52.849 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76703.log 2023-11-08T19:53:52.850 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53873.log.gz 2023-11-08T19:53:52.850 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2023-11-08T19:53:52.850 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76703.log.gz 2023-11-08T19:53:52.850 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39344.log 2023-11-08T19:53:52.851 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40228.log 2023-11-08T19:53:53.464 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45165.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2023-11-08T19:53:53.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42517.log 2023-11-08T19:53:53.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39344.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39344.log.gz 2023-11-08T19:53:53.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71562.log 2023-11-08T19:53:53.466 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40228.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40228.log.gz 2023-11-08T19:53:53.466 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42217.log 2023-11-08T19:53:53.466 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42517.log.gz 2023-11-08T19:53:53.467 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46659.log 2023-11-08T19:53:53.467 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71562.log.gz 2023-11-08T19:53:53.467 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34758.log 2023-11-08T19:53:53.467 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42217.log.gz 2023-11-08T19:53:53.468 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67303.log 2023-11-08T19:53:53.468 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46659.log.gz 2023-11-08T19:53:53.468 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49156.log 2023-11-08T19:53:53.468 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34758.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34758.log.gz 2023-11-08T19:53:53.469 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67862.log 2023-11-08T19:53:53.469 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67303.log.gz 2023-11-08T19:53:53.469 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2023-11-08T19:53:53.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49156.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.49156.log.gz 2023-11-08T19:53:53.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2023-11-08T19:53:53.470 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67862.log.gz 2023-11-08T19:53:53.470 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64738.log 2023-11-08T19:53:53.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2023-11-08T19:53:53.471 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37840.log 2023-11-08T19:53:53.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz 2023-11-08T19:53:53.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2023-11-08T19:53:53.472 INFO:teuthology.orchestra.run.smithi196.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.64738.log.gz 2023-11-08T19:53:53.472 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40789.log 2023-11-08T19:53:53.472 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37840.log.gz 2023-11-08T19:53:53.472 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67475.log 2023-11-08T19:53:53.473 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51524.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2023-11-08T19:53:53.473 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2023-11-08T19:53:53.473 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40789.log.gz 2023-11-08T19:53:53.474 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73179.log 2023-11-08T19:53:53.474 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67475.log.gz 2023-11-08T19:53:53.474 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75010.log 2023-11-08T19:53:53.474 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2023-11-08T19:53:53.475 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36572.log 2023-11-08T19:53:53.475 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73179.log.gz 2023-11-08T19:53:53.475 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60212.log 2023-11-08T19:53:53.475 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75010.log.gz 2023-11-08T19:53:53.476 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.36572.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49966.log 2023-11-08T19:53:53.476 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2023-11-08T19:53:53.476 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47176.log 2023-11-08T19:53:53.477 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60212.log.gz 2023-11-08T19:53:53.477 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76745.log 2023-11-08T19:53:53.477 INFO:teuthology.orchestra.run.smithi196.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.49966.log.gz 2023-11-08T19:53:53.477 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2023-11-08T19:53:53.478 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47176.log.gz 2023-11-08T19:53:53.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43003.log 2023-11-08T19:53:53.478 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76745.log.gz 2023-11-08T19:53:53.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52781.log 2023-11-08T19:53:53.479 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2023-11-08T19:53:53.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.43003.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35392.log 2023-11-08T19:53:53.479 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43003.log.gz 2023-11-08T19:53:53.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63439.log 2023-11-08T19:53:53.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52781.log.gz 2023-11-08T19:53:53.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73956.log 2023-11-08T19:53:53.480 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35392.log.gz 2023-11-08T19:53:53.481 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55807.log 2023-11-08T19:53:53.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63439.log.gz 2023-11-08T19:53:53.481 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73956.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77321.log 2023-11-08T19:53:53.481 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73956.log.gz 2023-11-08T19:53:53.482 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56821.log 2023-11-08T19:53:53.482 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55807.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.55807.log.gz--verbose 2023-11-08T19:53:53.482 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.67281.log 2023-11-08T19:53:53.482 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77321.log.gz 2023-11-08T19:53:53.483 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54791.log 2023-11-08T19:53:53.483 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56821.log.gz 2023-11-08T19:53:53.483 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38637.log 2023-11-08T19:53:53.484 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67281.log.gz 2023-11-08T19:53:53.484 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76509.log 2023-11-08T19:53:53.484 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54791.log.gz 2023-11-08T19:53:53.484 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2023-11-08T19:53:53.485 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38637.log.gz 2023-11-08T19:53:53.485 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62891.log 2023-11-08T19:53:53.485 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76509.log.gz 2023-11-08T19:53:53.486 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40347.log 2023-11-08T19:53:53.486 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2023-11-08T19:53:53.486 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68773.log 2023-11-08T19:53:53.486 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62891.log.gz 2023-11-08T19:53:53.487 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72056.log 2023-11-08T19:53:53.487 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40347.log.gz 2023-11-08T19:53:53.487 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41697.log 2023-11-08T19:53:53.487 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68773.log.gz 2023-11-08T19:53:53.488 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68055.log 2023-11-08T19:53:53.488 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72056.log.gz 2023-11-08T19:53:53.488 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2023-11-08T19:53:53.488 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41697.log.gz 2023-11-08T19:53:53.489 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57461.log 2023-11-08T19:53:53.489 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68055.log.gz 2023-11-08T19:53:53.489 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81143.log 2023-11-08T19:53:53.489 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2023-11-08T19:53:53.490 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38530.log /var/log/ceph/ceph-client.admin.57461.log: 2023-11-08T19:53:53.490 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57461.log.gz 2023-11-08T19:53:53.490 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47974.log 2023-11-08T19:53:53.491 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81143.log.gz 2023-11-08T19:53:53.491 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38286.log 2023-11-08T19:53:53.491 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38530.log.gz 2023-11-08T19:53:53.492 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2023-11-08T19:53:53.492 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47974.log.gz 2023-11-08T19:53:53.492 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64505.log 2023-11-08T19:53:53.492 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38286.log: /var/log/ceph/ceph-client.admin.43666.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38286.log.gz 2023-11-08T19:53:53.493 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45543.log 2023-11-08T19:53:53.493 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2023-11-08T19:53:53.493 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53343.log 2023-11-08T19:53:53.493 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64505.log.gz 2023-11-08T19:53:53.494 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59196.log 2023-11-08T19:53:53.494 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45543.log.gz 2023-11-08T19:53:53.494 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60861.log 2023-11-08T19:53:53.494 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53343.log.gz 2023-11-08T19:53:53.495 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67109.log 2023-11-08T19:53:53.495 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59196.log.gz 2023-11-08T19:53:53.495 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56907.log 2023-11-08T19:53:53.496 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60861.log.gz 2023-11-08T19:53:53.496 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2023-11-08T19:53:53.496 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67109.log.gz 2023-11-08T19:53:53.496 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56325.log 2023-11-08T19:53:53.497 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56907.log.gz 2023-11-08T19:53:53.497 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37995.log 2023-11-08T19:53:53.497 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2023-11-08T19:53:53.497 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62934.log 2023-11-08T19:53:53.498 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56325.log.gz 2023-11-08T19:53:53.498 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.37995.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2023-11-08T19:53:53.498 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37995.log.gz 2023-11-08T19:53:53.498 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76337.log 2023-11-08T19:53:53.499 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62934.log.gz 2023-11-08T19:53:53.499 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51917.log 2023-11-08T19:53:53.499 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36915.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2023-11-08T19:53:53.500 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54731.log /var/log/ceph/ceph-client.admin.76337.log: 2023-11-08T19:53:53.500 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76337.log.gz 2023-11-08T19:53:53.500 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63669.log 2023-11-08T19:53:53.500 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51917.log.gz 2023-11-08T19:53:53.501 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67002.log 2023-11-08T19:53:53.501 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54731.log.gz 2023-11-08T19:53:53.501 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71735.log 2023-11-08T19:53:53.501 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63669.log.gz 2023-11-08T19:53:53.502 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60169.log 2023-11-08T19:53:53.502 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67002.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.63863.log 2023-11-08T19:53:53.502 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67002.log.gz 2023-11-08T19:53:53.502 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71735.log.gz 2023-11-08T19:53:53.503 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62137.log 2023-11-08T19:53:53.503 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60169.log.gz 2023-11-08T19:53:53.503 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64779.log 2023-11-08T19:53:53.504 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63863.log.gz 2023-11-08T19:53:53.504 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49739.log 2023-11-08T19:53:53.504 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62137.log.gz 2023-11-08T19:53:53.504 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65100.log 2023-11-08T19:53:53.505 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64779.log.gz 2023-11-08T19:53:53.505 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65573.log 2023-11-08T19:53:53.505 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49739.log.gz 2023-11-08T19:53:53.505 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61377.log 2023-11-08T19:53:53.506 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65100.log.gz 2023-11-08T19:53:53.506 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2023-11-08T19:53:53.506 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65573.log.gz 2023-11-08T19:53:53.507 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56649.log 2023-11-08T19:53:53.507 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61377.log.gz 2023-11-08T19:53:53.507 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.57337.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55349.log 2023-11-08T19:53:53.507 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2023-11-08T19:53:53.508 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40007.log 2023-11-08T19:53:53.508 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56649.log.gz 2023-11-08T19:53:53.508 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63084.log 2023-11-08T19:53:53.508 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55349.log.gz 2023-11-08T19:53:53.509 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54122.log 2023-11-08T19:53:53.509 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40007.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40007.log.gz 2023-11-08T19:53:53.509 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44091.log 2023-11-08T19:53:53.509 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63084.log.gz 2023-11-08T19:53:53.510 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2023-11-08T19:53:53.510 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54122.log.gz 2023-11-08T19:53:53.510 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51896.log 2023-11-08T19:53:53.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44091.log.gz 2023-11-08T19:53:53.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80143.log 2023-11-08T19:53:53.511 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2023-11-08T19:53:53.511 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37560.log 2023-11-08T19:53:53.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51896.log.gz 2023-11-08T19:53:53.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2023-11-08T19:53:53.512 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80143.log.gz 2023-11-08T19:53:53.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34485.log 2023-11-08T19:53:53.513 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37560.log.gz 2023-11-08T19:53:53.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34196.log 2023-11-08T19:53:53.513 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2023-11-08T19:53:53.513 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52738.log 2023-11-08T19:53:53.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34485.log.gz 2023-11-08T19:53:53.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81116.log 2023-11-08T19:53:53.514 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34196.log.gz 2023-11-08T19:53:53.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38096.log 2023-11-08T19:53:53.515 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52738.log.gz 2023-11-08T19:53:53.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65057.log 2023-11-08T19:53:53.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81116.log.gz 2023-11-08T19:53:53.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.38096.log: -- /var/log/ceph/ceph-client.admin.72269.log 2023-11-08T19:53:53.516 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38096.log.gz 2023-11-08T19:53:53.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45840.log 2023-11-08T19:53:53.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65057.log.gz 2023-11-08T19:53:53.517 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70499.log 2023-11-08T19:53:53.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72269.log.gz 2023-11-08T19:53:53.517 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34549.log 2023-11-08T19:53:53.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45840.log.gz 2023-11-08T19:53:53.518 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2023-11-08T19:53:53.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70499.log: /var/log/ceph/ceph-client.admin.34549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66341.log 2023-11-08T19:53:53.519 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70499.log.gz 2023-11-08T19:53:53.519 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34549.log.gz 2023-11-08T19:53:53.519 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72172.log 2023-11-08T19:53:53.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2023-11-08T19:53:53.520 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57947.log 2023-11-08T19:53:53.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66341.log.gz 2023-11-08T19:53:53.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2023-11-08T19:53:53.520 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72172.log.gz 2023-11-08T19:53:53.521 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43377.log 2023-11-08T19:53:53.521 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57947.log.gz 2023-11-08T19:53:53.521 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-11-08T19:53:53.521 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2023-11-08T19:53:53.522 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2023-11-08T19:53:53.522 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43377.log: /var/log/ceph/ceph-client.admin.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2023-11-08T19:53:53.522 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43377.log.gz 2023-11-08T19:53:53.523 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-11-08T19:53:53.523 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56778.log 2023-11-08T19:53:53.523 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2023-11-08T19:53:53.523 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53146.log 2023-11-08T19:53:53.524 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2023-11-08T19:53:53.524 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75117.log 2023-11-08T19:53:53.524 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56778.log.gz 2023-11-08T19:53:53.524 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41437.log 2023-11-08T19:53:53.525 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53146.log.gz 2023-11-08T19:53:53.525 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77579.log 2023-11-08T19:53:53.525 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75117.log.gz 2023-11-08T19:53:53.526 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73307.log 2023-11-08T19:53:53.526 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41437.log.gz 2023-11-08T19:53:53.526 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52996.log 2023-11-08T19:53:53.526 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77579.log.gz 2023-11-08T19:53:53.527 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2023-11-08T19:53:53.527 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73307.log.gz 2023-11-08T19:53:53.527 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.52996.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58054.log 2023-11-08T19:53:53.527 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52996.log.gz 2023-11-08T19:53:53.528 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63251.log 2023-11-08T19:53:53.528 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2023-11-08T19:53:53.528 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58011.log 2023-11-08T19:53:53.528 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58054.log.gz 2023-11-08T19:53:53.529 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59236.log 2023-11-08T19:53:53.529 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63251.log.gz 2023-11-08T19:53:53.529 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79085.log 2023-11-08T19:53:53.530 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58011.log.gz 2023-11-08T19:53:53.530 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73763.log 2023-11-08T19:53:53.530 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59236.log.gz 2023-11-08T19:53:53.530 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2023-11-08T19:53:53.531 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79085.log.gz 2023-11-08T19:53:53.531 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73763.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76765.log 2023-11-08T19:53:53.531 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73763.log.gz 2023-11-08T19:53:53.531 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42357.log 2023-11-08T19:53:53.532 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2023-11-08T19:53:53.532 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2023-11-08T19:53:53.532 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76765.log.gz 2023-11-08T19:53:53.533 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70005.log 2023-11-08T19:53:53.533 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42357.log.gz 2023-11-08T19:53:53.533 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log: /var/log/ceph/ceph-client.admin.66894.log 2023-11-08T19:53:53.533 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2023-11-08T19:53:53.534 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50357.log 2023-11-08T19:53:53.534 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70005.log.gz 2023-11-08T19:53:53.534 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65487.log 2023-11-08T19:53:53.535 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66894.log.gz 2023-11-08T19:53:53.535 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50357.log: /var/log/ceph/ceph-client.admin.77782.log 2023-11-08T19:53:53.535 INFO:teuthology.orchestra.run.smithi196.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.50357.log.gz 2023-11-08T19:53:53.535 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2023-11-08T19:53:53.536 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65487.log.gz 2023-11-08T19:53:53.536 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43190.log 2023-11-08T19:53:53.536 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77782.log.gz 2023-11-08T19:53:53.536 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50337.log 2023-11-08T19:53:53.537 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2023-11-08T19:53:53.537 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57100.log 2023-11-08T19:53:53.537 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43190.log.gz 2023-11-08T19:53:53.537 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36529.log 2023-11-08T19:53:53.538 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50337.log.gz 2023-11-08T19:53:53.538 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70479.log 2023-11-08T19:53:53.538 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57100.log.gz 2023-11-08T19:53:53.539 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74537.log 2023-11-08T19:53:53.539 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36529.log.gz 2023-11-08T19:53:53.539 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.70479.log: -- /var/log/ceph/ceph-client.admin.40517.log 2023-11-08T19:53:53.539 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70479.log.gz 2023-11-08T19:53:53.540 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39208.log 2023-11-08T19:53:53.540 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74537.log.gz 2023-11-08T19:53:53.540 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64820.log 2023-11-08T19:53:53.541 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2023-11-08T19:53:53.541 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.39208.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77192.log 2023-11-08T19:53:53.541 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39208.log.gz 2023-11-08T19:53:53.541 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2023-11-08T19:53:53.542 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64820.log.gz 2023-11-08T19:53:53.542 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81170.log 2023-11-08T19:53:53.542 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77192.log.gz 2023-11-08T19:53:53.542 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68581.log 2023-11-08T19:53:53.543 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2023-11-08T19:53:53.543 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72191.log 2023-11-08T19:53:53.543 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81170.log.gz 2023-11-08T19:53:53.544 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71032.log 2023-11-08T19:53:53.544 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68581.log.gz 2023-11-08T19:53:53.544 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42817.log 2023-11-08T19:53:53.544 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72191.log.gz 2023-11-08T19:53:53.545 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41277.log 2023-11-08T19:53:53.545 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71032.log.gz 2023-11-08T19:53:53.545 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.42817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33702.log 2023-11-08T19:53:53.545 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42817.log.gz 2023-11-08T19:53:53.546 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81089.log 2023-11-08T19:53:53.546 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41277.log: /var/log/ceph/ceph-client.admin.33702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41277.log.gz 2023-11-08T19:53:53.546 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60597.log 2023-11-08T19:53:53.547 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33702.log.gz 2023-11-08T19:53:53.547 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73041.log 2023-11-08T19:53:53.547 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81089.log.gz 2023-11-08T19:53:53.547 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.60597.log: -- /var/log/ceph/ceph-client.admin.52566.log 2023-11-08T19:53:53.548 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60597.log.gz 2023-11-08T19:53:53.548 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53168.log 2023-11-08T19:53:53.548 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73041.log.gz 2023-11-08T19:53:53.548 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42157.log 2023-11-08T19:53:53.549 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52566.log.gz 2023-11-08T19:53:53.549 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59739.log 2023-11-08T19:53:53.549 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53168.log.gz 2023-11-08T19:53:53.550 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67539.log 2023-11-08T19:53:53.550 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42157.log.gz 2023-11-08T19:53:53.550 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48974.log 2023-11-08T19:53:53.550 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59739.log.gz 2023-11-08T19:53:53.551 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73407.log 2023-11-08T19:53:53.551 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67539.log.gz 2023-11-08T19:53:53.551 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42377.log 2023-11-08T19:53:53.551 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48974.log.gz 2023-11-08T19:53:53.552 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65988.log 2023-11-08T19:53:53.552 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73407.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.73407.log.gz 2023-11-08T19:53:53.552 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39565.log 2023-11-08T19:53:53.553 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42377.log.gz 2023-11-08T19:53:53.553 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2023-11-08T19:53:53.553 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65988.log.gz 2023-11-08T19:53:53.553 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78734.log 2023-11-08T19:53:53.554 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39565.log.gz 2023-11-08T19:53:53.554 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54872.log 2023-11-08T19:53:53.554 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2023-11-08T19:53:53.555 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45102.log 2023-11-08T19:53:53.555 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78734.log.gz 2023-11-08T19:53:53.555 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74666.log 2023-11-08T19:53:53.555 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54872.log.gz 2023-11-08T19:53:53.556 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.45102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75613.log 2023-11-08T19:53:53.556 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45102.log.gz 2023-11-08T19:53:53.556 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2023-11-08T19:53:53.556 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74666.log.gz 2023-11-08T19:53:53.557 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36218.log 2023-11-08T19:53:53.557 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75613.log.gz 2023-11-08T19:53:53.557 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70936.log 2023-11-08T19:53:53.557 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.30086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gz 2023-11-08T19:53:53.558 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68889.log 2023-11-08T19:53:53.558 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36218.log: /var/log/ceph/ceph-client.admin.70936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2023-11-08T19:53:53.558 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.36218.log.gz 2023-11-08T19:53:53.559 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70936.log.gz 2023-11-08T19:53:53.559 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60941.log 2023-11-08T19:53:53.559 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68889.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.68889.log.gz 2023-11-08T19:53:53.559 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35223.log 2023-11-08T19:53:53.560 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2023-11-08T19:53:53.560 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69299.log 2023-11-08T19:53:53.560 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60941.log.gz 2023-11-08T19:53:53.560 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36872.log 2023-11-08T19:53:53.561 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35223.log.gz 2023-11-08T19:53:53.561 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2023-11-08T19:53:53.561 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69299.log.gz 2023-11-08T19:53:53.562 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71715.log 2023-11-08T19:53:53.562 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36872.log.gz 2023-11-08T19:53:53.562 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log 2023-11-08T19:53:53.562 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39276.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2023-11-08T19:53:53.563 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80440.log 2023-11-08T19:53:53.563 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71715.log.gz 2023-11-08T19:53:53.563 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log: /var/log/ceph/ceph-client.admin.51303.log 2023-11-08T19:53:53.563 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54751.log.gz 2023-11-08T19:53:53.564 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76294.log 2023-11-08T19:53:53.564 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80440.log.gz 2023-11-08T19:53:53.564 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39650.log 2023-11-08T19:53:53.565 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51303.log.gz 2023-11-08T19:53:53.565 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75053.log 2023-11-08T19:53:53.565 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76294.log.gz 2023-11-08T19:53:53.565 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36615.log 2023-11-08T19:53:53.566 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39650.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39650.log.gz 2023-11-08T19:53:53.566 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69549.log 2023-11-08T19:53:53.566 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75053.log.gz 2023-11-08T19:53:53.567 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2023-11-08T19:53:53.567 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36615.log.gz 2023-11-08T19:53:53.567 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44516.log 2023-11-08T19:53:53.567 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69549.log.gz 2023-11-08T19:53:53.568 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2023-11-08T19:53:53.568 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39514.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2023-11-08T19:53:53.568 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2023-11-08T19:53:53.568 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44516.log.gz 2023-11-08T19:53:53.569 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73489.log 2023-11-08T19:53:53.569 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34968.log 2023-11-08T19:53:53.569 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2023-11-08T19:53:53.570 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34588.log: /var/log/ceph/ceph-client.admin.73489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2023-11-08T19:53:53.570 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75714.log 2023-11-08T19:53:53.570 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73489.log.gz 2023-11-08T19:53:53.570 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76574.log 2023-11-08T19:53:53.571 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34968.log.gz 2023-11-08T19:53:53.571 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2023-11-08T19:53:53.571 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75714.log.gz 2023-11-08T19:53:53.571 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34796.log 2023-11-08T19:53:53.572 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76574.log.gz 2023-11-08T19:53:53.572 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78437.log 2023-11-08T19:53:53.572 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2023-11-08T19:53:53.572 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44006.log 2023-11-08T19:53:53.573 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34796.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34796.log.gz 2023-11-08T19:53:53.573 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33637.log 2023-11-08T19:53:53.573 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78437.log.gz 2023-11-08T19:53:53.574 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2023-11-08T19:53:53.574 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44006.log.gz 2023-11-08T19:53:53.574 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42257.log 2023-11-08T19:53:53.574 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33637.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33637.log.gz-5 2023-11-08T19:53:53.575 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42837.log 2023-11-08T19:53:53.575 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2023-11-08T19:53:53.575 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40432.log 2023-11-08T19:53:53.575 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42257.log.gz 2023-11-08T19:53:53.576 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79031.log 2023-11-08T19:53:53.576 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42837.log.gz 2023-11-08T19:53:53.576 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.40432.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72934.log 2023-11-08T19:53:53.576 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40432.log.gz 2023-11-08T19:53:53.577 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62375.log 2023-11-08T19:53:53.577 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79031.log.gz 2023-11-08T19:53:53.577 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2023-11-08T19:53:53.578 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72934.log.gz 2023-11-08T19:53:53.578 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74322.log 2023-11-08T19:53:53.578 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62375.log.gz 2023-11-08T19:53:53.578 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37797.log 2023-11-08T19:53:53.579 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2023-11-08T19:53:53.579 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62805.log 2023-11-08T19:53:53.579 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74322.log.gz 2023-11-08T19:53:53.579 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2023-11-08T19:53:53.580 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37797.log.gz 2023-11-08T19:53:53.580 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60881.log 2023-11-08T19:53:53.580 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62805.log.gz 2023-11-08T19:53:53.581 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41397.log 2023-11-08T19:53:53.581 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2023-11-08T19:53:53.581 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55217.log 2023-11-08T19:53:53.581 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60881.log.gz 2023-11-08T19:53:53.582 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2023-11-08T19:53:53.582 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41397.log.gz 2023-11-08T19:53:53.582 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2023-11-08T19:53:53.582 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55217.log.gz 2023-11-08T19:53:53.583 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39752.log 2023-11-08T19:53:53.583 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2023-11-08T19:53:53.583 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77214.log 2023-11-08T19:53:53.583 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2023-11-08T19:53:53.584 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40874.log 2023-11-08T19:53:53.584 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39752.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39752.log.gz 2023-11-08T19:53:53.584 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57294.log 2023-11-08T19:53:53.585 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77214.log.gz 2023-11-08T19:53:53.585 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2023-11-08T19:53:53.585 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40874.log.gz 2023-11-08T19:53:53.585 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2023-11-08T19:53:53.586 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57294.log.gz 2023-11-08T19:53:53.586 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72547.log 2023-11-08T19:53:53.586 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2023-11-08T19:53:53.586 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30198.log 2023-11-08T19:53:53.587 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2023-11-08T19:53:53.587 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75550.log 2023-11-08T19:53:53.587 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72547.log.gz 2023-11-08T19:53:53.588 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65832.log 2023-11-08T19:53:53.588 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.30198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30198.log.gz 2023-11-08T19:53:53.588 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39905.log 2023-11-08T19:53:53.588 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75550.log: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.75550.log.gz 2023-11-08T19:53:53.589 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48829.log 2023-11-08T19:53:53.589 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65832.log.gz 2023-11-08T19:53:53.589 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80873.log 2023-11-08T19:53:53.589 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39905.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39905.log.gz 2023-11-08T19:53:53.590 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65927.log 2023-11-08T19:53:53.590 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48829.log.gz 2023-11-08T19:53:53.590 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44871.log /var/log/ceph/ceph-client.admin.80873.log: 2023-11-08T19:53:53.591 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80873.log.gz 2023-11-08T19:53:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71109.log 2023-11-08T19:53:53.591 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65927.log.gz 2023-11-08T19:53:53.591 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2023-11-08T19:53:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44871.log.gz 2023-11-08T19:53:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70642.log 2023-11-08T19:53:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71109.log.gz 2023-11-08T19:53:53.592 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50943.log 2023-11-08T19:53:53.593 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2023-11-08T19:53:53.593 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70642.log: /var/log/ceph/ceph-client.admin.37668.log 2023-11-08T19:53:53.593 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70642.log.gz 2023-11-08T19:53:53.594 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2023-11-08T19:53:53.594 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50943.log.gz 2023-11-08T19:53:53.594 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75952.log 2023-11-08T19:53:53.594 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37668.log.gz 2023-11-08T19:53:53.595 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log: /var/log/ceph/ceph-client.admin.56368.log 2023-11-08T19:53:53.595 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2023-11-08T19:53:53.595 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63165.log 2023-11-08T19:53:53.595 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75952.log.gz 2023-11-08T19:53:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38358.log 2023-11-08T19:53:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56368.log.gz 2023-11-08T19:53:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2023-11-08T19:53:53.596 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63165.log.gz 2023-11-08T19:53:53.597 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52630.log 2023-11-08T19:53:53.597 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38358.log.gz 2023-11-08T19:53:53.597 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77149.log 2023-11-08T19:53:53.598 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2023-11-08T19:53:53.598 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.52630.log: --verbose -- /var/log/ceph/ceph-client.admin.72912.log 2023-11-08T19:53:53.598 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52630.log.gz 2023-11-08T19:53:53.598 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50423.log 2023-11-08T19:53:53.599 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77149.log.gz 2023-11-08T19:53:53.599 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2023-11-08T19:53:53.599 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72912.log.gz 2023-11-08T19:53:53.599 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45354.log 2023-11-08T19:53:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68828.log 23.3% 2023-11-08T19:53:53.600 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50423.log.gz 2023-11-08T19:53:53.600 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39633.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2023-11-08T19:53:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.45354.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75774.log 2023-11-08T19:53:53.601 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2023-11-08T19:53:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2023-11-08T19:53:53.601 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68828.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.79274.log 2023-11-08T19:53:53.602 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68828.log.gz 2023-11-08T19:53:53.602 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75774.log: /var/log/ceph/ceph-client.admin.37130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35822.log 2023-11-08T19:53:53.602 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75774.log.gz 2023-11-08T19:53:53.602 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2023-11-08T19:53:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63293.log 2023-11-08T19:53:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79274.log.gz 2023-11-08T19:53:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46281.log 2023-11-08T19:53:53.603 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35822.log.gz 2023-11-08T19:53:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65595.log 2023-11-08T19:53:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63293.log.gz 2023-11-08T19:53:53.604 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39939.log 2023-11-08T19:53:53.605 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46281.log.gz 2023-11-08T19:53:53.605 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2023-11-08T19:53:53.605 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65595.log.gz 2023-11-08T19:53:53.605 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67260.log 2023-11-08T19:53:53.606 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39939.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39939.log.gz 2023-11-08T19:53:53.606 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60901.log 2023-11-08T19:53:53.606 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2023-11-08T19:53:53.606 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44142.log 2023-11-08T19:53:53.607 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67260.log.gz 2023-11-08T19:53:53.607 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2023-11-08T19:53:53.607 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60901.log.gz 2023-11-08T19:53:53.607 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64185.log 2023-11-08T19:53:53.608 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44142.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.44142.log.gz--verbose 2023-11-08T19:53:53.608 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.32804.log 2023-11-08T19:53:53.608 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54851.log: gzip /var/log/ceph/ceph-client.admin.64185.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56993.log 2023-11-08T19:53:53.609 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2023-11-08T19:53:53.609 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64185.log.gz 2023-11-08T19:53:53.609 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45312.log 2023-11-08T19:53:53.609 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2023-11-08T19:53:53.610 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2023-11-08T19:53:53.610 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56993.log.gz 2023-11-08T19:53:53.610 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58355.log 2023-11-08T19:53:53.610 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45312.log.gz 2023-11-08T19:53:53.611 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33917.log 2023-11-08T19:53:53.611 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2023-11-08T19:53:53.611 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2023-11-08T19:53:53.612 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58355.log.gz 2023-11-08T19:53:53.612 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76036.log 2023-11-08T19:53:53.612 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33917.log.gz 2023-11-08T19:53:53.612 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2023-11-08T19:53:53.613 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2023-11-08T19:53:53.613 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.76036.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.81414.log 2023-11-08T19:53:53.613 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76036.log.gz 2023-11-08T19:53:53.613 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2023-11-08T19:53:53.614 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2023-11-08T19:53:53.614 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45396.log 2023-11-08T19:53:53.614 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81414.log.gz 2023-11-08T19:53:53.614 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2023-11-08T19:53:53.615 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2023-11-08T19:53:53.615 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.45396.log: --verbose -- /var/log/ceph/ceph-client.admin.40568.log 2023-11-08T19:53:53.615 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45396.log.gz 2023-11-08T19:53:53.616 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2023-11-08T19:53:53.616 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39786.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2023-11-08T19:53:53.616 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45669.log 2023-11-08T19:53:53.616 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40568.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40568.log.gz 2023-11-08T19:53:53.617 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53815.log 2023-11-08T19:53:53.617 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gz 2023-11-08T19:53:53.617 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33616.log 2023-11-08T19:53:53.617 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45669.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45669.log.gz 2023-11-08T19:53:53.618 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74279.log 2023-11-08T19:53:53.618 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53815.log.gz 2023-11-08T19:53:53.618 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37711.log 2023-11-08T19:53:53.619 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33616.log.gz 2023-11-08T19:53:53.619 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66707.log 2023-11-08T19:53:53.619 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74279.log.gz 2023-11-08T19:53:53.619 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79139.log 2023-11-08T19:53:53.620 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37711.log.gz 2023-11-08T19:53:53.620 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52326.log 2023-11-08T19:53:53.620 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66707.log.gz 2023-11-08T19:53:53.621 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53856.log 2023-11-08T19:53:53.621 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79139.log.gz 2023-11-08T19:53:53.621 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71975.log 2023-11-08T19:53:53.621 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52326.log.gz 2023-11-08T19:53:53.622 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80386.log 2023-11-08T19:53:53.622 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53856.log.gz 2023-11-08T19:53:53.622 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49655.log 2023-11-08T19:53:53.623 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36112.log 2023-11-08T19:53:53.623 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71975.log.gz 2023-11-08T19:53:53.623 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80386.log: /var/log/ceph/ceph-client.admin.49655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80521.log 2023-11-08T19:53:53.623 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80386.log.gz 2023-11-08T19:53:53.624 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49655.log.gz 2023-11-08T19:53:53.624 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64971.log 2023-11-08T19:53:53.624 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71149.log 2023-11-08T19:53:53.624 INFO:teuthology.orchestra.run.smithi196.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.36112.log.gz 2023-11-08T19:53:53.625 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80521.log: /var/log/ceph/ceph-client.admin.64971.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.80521.log.gz-- 2023-11-08T19:53:53.625 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75407.log 2023-11-08T19:53:53.625 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64971.log.gz 2023-11-08T19:53:53.625 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38766.log 2023-11-08T19:53:53.626 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71149.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.68370.log 2023-11-08T19:53:53.626 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71149.log.gz 2023-11-08T19:53:53.626 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75407.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.75407.log.gz 2023-11-08T19:53:53.627 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.51810.log 2023-11-08T19:53:53.627 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38766.log.gz 2023-11-08T19:53:53.627 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39395.log 2023-11-08T19:53:53.627 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68370.log.gz 2023-11-08T19:53:53.628 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74924.log 2023-11-08T19:53:53.628 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51810.log.gz 2023-11-08T19:53:53.628 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63626.log 2023-11-08T19:53:53.628 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39395.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39395.log.gz 2023-11-08T19:53:53.629 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66583.log 2023-11-08T19:53:53.629 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74924.log.gz 2023-11-08T19:53:53.629 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80251.log 2023-11-08T19:53:53.629 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63626.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.63626.log.gz 2023-11-08T19:53:53.630 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log 2023-11-08T19:53:53.630 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66583.log.gz 2023-11-08T19:53:53.630 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46596.log 2023-11-08T19:53:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80251.log.gz 2023-11-08T19:53:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log: /var/log/ceph/ceph-client.admin.69008.log 2023-11-08T19:53:53.631 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41077.log.gz 2023-11-08T19:53:53.631 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67840.log 2023-11-08T19:53:53.632 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46596.log.gz 2023-11-08T19:53:53.632 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57143.log 2023-11-08T19:53:53.632 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69008.log.gz 2023-11-08T19:53:53.632 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74085.log 2023-11-08T19:53:53.633 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67840.log.gz 2023-11-08T19:53:53.633 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40177.log 2023-11-08T19:53:53.633 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57143.log.gz 2023-11-08T19:53:53.633 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62352.log 2023-11-08T19:53:53.634 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74085.log.gz 2023-11-08T19:53:53.634 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56111.log 2023-11-08T19:53:53.634 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40177.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40177.log.gz 2023-11-08T19:53:53.635 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79656.log 2023-11-08T19:53:53.635 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62352.log.gz 2023-11-08T19:53:53.635 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69823.log 2023-11-08T19:53:53.635 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56111.log.gz 2023-11-08T19:53:53.636 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50563.log 2023-11-08T19:53:53.636 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79656.log.gz 2023-11-08T19:53:53.636 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2023-11-08T19:53:53.636 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69823.log.gz 2023-11-08T19:53:53.637 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65358.log /var/log/ceph/ceph-client.admin.50563.log: 2023-11-08T19:53:53.637 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50563.log.gz 2023-11-08T19:53:53.637 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.36037.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36465.log 2023-11-08T19:53:53.638 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2023-11-08T19:53:53.638 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73200.log 2023-11-08T19:53:53.638 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65358.log.gz 2023-11-08T19:53:53.638 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72015.log 2023-11-08T19:53:53.639 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36465.log.gz 2023-11-08T19:53:53.639 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73200.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73119.log 2023-11-08T19:53:53.639 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73200.log.gz 2023-11-08T19:53:53.639 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2023-11-08T19:53:53.640 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72015.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.72015.log.gz 2023-11-08T19:53:53.640 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38227.log 2023-11-08T19:53:53.640 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73119.log.gz 2023-11-08T19:53:53.641 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47769.log 2023-11-08T19:53:53.641 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2023-11-08T19:53:53.641 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42857.log 2023-11-08T19:53:53.641 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38227.log.gz 2023-11-08T19:53:53.642 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61295.log 2023-11-08T19:53:53.642 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47769.log.gz 2023-11-08T19:53:53.642 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77665.log 2023-11-08T19:53:53.643 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42857.log: /var/log/ceph/ceph-client.admin.61295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42857.log.gz 2023-11-08T19:53:53.643 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67023.log 2023-11-08T19:53:53.643 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61295.log.gz 2023-11-08T19:53:53.643 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2023-11-08T19:53:53.644 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77665.log.gz 2023-11-08T19:53:53.644 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2023-11-08T19:53:53.644 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67023.log.gz 2023-11-08T19:53:53.644 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2023-11-08T19:53:53.645 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2023-11-08T19:53:53.645 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35994.log 2023-11-08T19:53:53.645 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42537.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65186.log 2023-11-08T19:53:53.645 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40636.log: -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2023-11-08T19:53:53.646 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2023-11-08T19:53:53.646 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2023-11-08T19:53:53.646 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35994.log.gz 2023-11-08T19:53:53.647 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66726.log 2023-11-08T19:53:53.647 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72461.log 2023-11-08T19:53:53.647 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65186.log.gz 2023-11-08T19:53:53.647 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52390.log 2023-11-08T19:53:53.648 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66726.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2023-11-08T19:53:53.648 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66726.log.gz 2023-11-08T19:53:53.648 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36723.log 2023-11-08T19:53:53.648 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72461.log.gz 2023-11-08T19:53:53.649 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32858.log 2023-11-08T19:53:53.649 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52390.log.gz 2023-11-08T19:53:53.649 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67561.log 2023-11-08T19:53:53.649 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36723.log.gz 2023-11-08T19:53:53.650 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32966.log 2023-11-08T19:53:53.650 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32858.log.gz 2023-11-08T19:53:53.650 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72826.log 2023-11-08T19:53:53.651 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67561.log.gz 2023-11-08T19:53:53.651 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2023-11-08T19:53:53.651 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32966.log.gz 2023-11-08T19:53:53.651 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65908.log 2023-11-08T19:53:53.652 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72826.log: 0.0%/var/log/ceph/ceph-client.admin.47284.log: -- replaced with /var/log/ceph/ceph-client.admin.72826.log.gz 2023-11-08T19:53:53.652 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66009.log 2023-11-08T19:53:53.652 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2023-11-08T19:53:53.652 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63755.log 2023-11-08T19:53:53.653 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65908.log.gz 2023-11-08T19:53:53.653 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67647.log 2023-11-08T19:53:53.653 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66009.log: /var/log/ceph/ceph-client.admin.63755.log: 0.0%gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.66009.log.gz -- replaced with /var/log/ceph/ceph-client.admin.63755.log.gz-- 2023-11-08T19:53:53.654 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.654 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43428.log 2023-11-08T19:53:53.654 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2023-11-08T19:53:53.654 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67647.log.gz 2023-11-08T19:53:53.655 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63841.log 2023-11-08T19:53:53.655 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2023-11-08T19:53:53.655 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2023-11-08T19:53:53.656 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2023-11-08T19:53:53.656 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74773.log 2023-11-08T19:53:53.656 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63841.log.gz 2023-11-08T19:53:53.656 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2023-11-08T19:53:53.657 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40602.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2023-11-08T19:53:53.657 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78220.log 2023-11-08T19:53:53.657 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74773.log.gz 2023-11-08T19:53:53.657 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67926.log 2023-11-08T19:53:53.658 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39259.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2023-11-08T19:53:53.658 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2023-11-08T19:53:53.658 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78220.log.gz 2023-11-08T19:53:53.658 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45924.log 2023-11-08T19:53:53.659 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67926.log.gz 2023-11-08T19:53:53.659 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66439.log 2023-11-08T19:53:53.659 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2023-11-08T19:53:53.659 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2023-11-08T19:53:53.660 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45924.log.gz 2023-11-08T19:53:53.660 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2023-11-08T19:53:53.660 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66439.log.gz 2023-11-08T19:53:53.661 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2023-11-08T19:53:53.661 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz 2023-11-08T19:53:53.661 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51241.log 2023-11-08T19:53:53.661 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2023-11-08T19:53:53.662 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2023-11-08T19:53:53.662 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2023-11-08T19:53:53.662 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65680.log 2023-11-08T19:53:53.662 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51241.log.gz 2023-11-08T19:53:53.663 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76660.log 2023-11-08T19:53:53.663 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz 2023-11-08T19:53:53.663 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36766.log 2023-11-08T19:53:53.663 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65680.log.gz 2023-11-08T19:53:53.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2023-11-08T19:53:53.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76660.log.gz 2023-11-08T19:53:53.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62288.log 2023-11-08T19:53:53.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36766.log.gz 2023-11-08T19:53:53.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73784.log 2023-11-08T19:53:53.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2023-11-08T19:53:53.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43275.log 2023-11-08T19:53:53.666 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62288.log.gz 2023-11-08T19:53:53.666 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log 2023-11-08T19:53:53.666 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73784.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.73784.log.gz 2023-11-08T19:53:53.666 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67668.log 2023-11-08T19:53:53.667 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43275.log.gz 2023-11-08T19:53:53.667 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54617.log: /var/log/ceph/ceph-client.admin.41537.log 2023-11-08T19:53:53.667 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54617.log.gz 2023-11-08T19:53:53.668 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42197.log 2023-11-08T19:53:53.668 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67668.log.gz 2023-11-08T19:53:53.668 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34702.log 2023-11-08T19:53:53.668 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75341.log 2023-11-08T19:53:53.669 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41537.log.gz 2023-11-08T19:53:53.669 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42197.log.gz 2023-11-08T19:53:53.669 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73139.log 2023-11-08T19:53:53.669 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34702.log.gz 2023-11-08T19:53:53.670 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51204.log 2023-11-08T19:53:53.670 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75341.log.gz 2023-11-08T19:53:53.670 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55035.log 2023-11-08T19:53:53.671 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73139.log.gz 2023-11-08T19:53:53.671 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48995.log 2023-11-08T19:53:53.671 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51204.log.gz 2023-11-08T19:53:53.671 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44601.log 2023-11-08T19:53:53.672 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55035.log.gz 2023-11-08T19:53:53.672 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48426.log 2023-11-08T19:53:53.672 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48995.log.gz 2023-11-08T19:53:53.672 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57628.log 2023-11-08T19:53:53.673 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76445.log 2023-11-08T19:53:53.673 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44601.log.gz 2023-11-08T19:53:53.673 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48426.log.gz 2023-11-08T19:53:53.673 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56626.log 2023-11-08T19:53:53.674 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57628.log.gz 2023-11-08T19:53:53.674 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65208.log 2023-11-08T19:53:53.674 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76445.log.gz 2023-11-08T19:53:53.675 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70663.log 2023-11-08T19:53:53.675 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56626.log.gz 2023-11-08T19:53:53.675 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64640.log 2023-11-08T19:53:53.675 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65208.log.gz 2023-11-08T19:53:53.676 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2023-11-08T19:53:53.676 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70663.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.70663.log.gz-- 2023-11-08T19:53:53.676 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38852.log 2023-11-08T19:53:53.676 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64640.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.64640.log.gz--verbose 2023-11-08T19:53:53.677 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.75031.log 2023-11-08T19:53:53.677 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2023-11-08T19:53:53.677 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70992.log 2023-11-08T19:53:53.678 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38852.log.gz 2023-11-08T19:53:53.678 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45480.log 2023-11-08T19:53:53.678 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75031.log.gz 2023-11-08T19:53:53.678 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34046.log 2023-11-08T19:53:53.679 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70992.log.gz 2023-11-08T19:53:53.679 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2023-11-08T19:53:53.679 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2023-11-08T19:53:53.680 INFO:teuthology.orchestra.run.smithi196.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45480.log.gz 2023-11-08T19:53:53.680 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34046.log.gz 2023-11-08T19:53:53.680 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46854.log 2023-11-08T19:53:53.681 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2023-11-08T19:53:53.681 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67733.log 2023-11-08T19:53:53.681 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2023-11-08T19:53:53.681 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77816.log 2023-11-08T19:53:53.682 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46854.log.gz 2023-11-08T19:53:53.682 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78329.log 2023-11-08T19:53:53.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67733.log.gz 2023-11-08T19:53:53.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55056.log 2023-11-08T19:53:53.683 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77816.log.gz 2023-11-08T19:53:53.683 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75972.log 2023-11-08T19:53:53.683 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78329.log.gz 2023-11-08T19:53:53.683 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69968.log 2023-11-08T19:53:53.684 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55056.log.gz 2023-11-08T19:53:53.684 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58162.log 2023-11-08T19:53:53.684 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75972.log.gz 2023-11-08T19:53:53.685 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.69968.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34523.log 2023-11-08T19:53:53.685 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69968.log.gz 2023-11-08T19:53:53.685 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2023-11-08T19:53:53.685 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58162.log.gz 2023-11-08T19:53:53.686 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66689.log 2023-11-08T19:53:53.686 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34523.log.gz 2023-11-08T19:53:53.686 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68636.log 2023-11-08T19:53:53.686 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2023-11-08T19:53:53.687 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51382.log 2023-11-08T19:53:53.687 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66689.log.gz 2023-11-08T19:53:53.687 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68677.log 2023-11-08T19:53:53.688 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68636.log.gz 2023-11-08T19:53:53.688 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40296.log 2023-11-08T19:53:53.688 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51382.log.gz 2023-11-08T19:53:53.688 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57251.log 2023-11-08T19:53:53.689 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68677.log.gz 2023-11-08T19:53:53.689 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69258.log 2023-11-08T19:53:53.689 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40296.log.gz 2023-11-08T19:53:53.689 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54058.log 2023-11-08T19:53:53.690 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57251.log.gz 2023-11-08T19:53:53.690 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70520.log 2023-11-08T19:53:53.690 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69258.log.gz 2023-11-08T19:53:53.691 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2023-11-08T19:53:53.691 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54058.log.gz 2023-11-08T19:53:53.691 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35736.log 2023-11-08T19:53:53.691 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70520.log.gz 2023-11-08T19:53:53.692 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65229.log 2023-11-08T19:53:53.692 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz 2023-11-08T19:53:53.692 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34872.log 2023-11-08T19:53:53.693 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35736.log.gz 2023-11-08T19:53:53.693 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.65229.log: --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2023-11-08T19:53:53.693 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65229.log.gz 2023-11-08T19:53:53.693 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61750.log 2023-11-08T19:53:53.694 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34872.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34872.log.gz 2023-11-08T19:53:53.694 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2023-11-08T19:53:53.694 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39463.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2023-11-08T19:53:53.694 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63777.log 2023-11-08T19:53:53.695 INFO:teuthology.orchestra.run.smithi196.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.61750.log.gz 2023-11-08T19:53:53.695 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2023-11-08T19:53:53.695 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37942.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2023-11-08T19:53:53.695 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2023-11-08T19:53:53.696 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63777.log.gz 2023-11-08T19:53:53.696 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43394.log 2023-11-08T19:53:53.696 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2023-11-08T19:53:53.697 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45018.log 2023-11-08T19:53:53.697 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2023-11-08T19:53:53.697 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65122.log 2023-11-08T19:53:53.697 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43394.log: /var/log/ceph/ceph-client.admin.45018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43394.log.gz 2023-11-08T19:53:53.698 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66851.log 2023-11-08T19:53:53.698 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45018.log.gz 2023-11-08T19:53:53.698 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45060.log 2023-11-08T19:53:53.698 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65122.log.gz 2023-11-08T19:53:53.699 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2023-11-08T19:53:53.699 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66851.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.66851.log.gz--verbose 2023-11-08T19:53:53.699 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.62266.log 2023-11-08T19:53:53.700 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45060.log.gz 2023-11-08T19:53:53.700 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74644.log 2023-11-08T19:53:53.700 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2023-11-08T19:53:53.700 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70158.log 2023-11-08T19:53:53.701 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62266.log.gz 2023-11-08T19:53:53.701 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38745.log 2023-11-08T19:53:53.701 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74644.log.gz 2023-11-08T19:53:53.701 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2023-11-08T19:53:53.702 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70158.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.70158.log.gz/var/log/ceph/ceph-client.admin.76380.log 2023-11-08T19:53:53.702 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.702 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55919.log 2023-11-08T19:53:53.703 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38745.log.gz 2023-11-08T19:53:53.703 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2023-11-08T19:53:53.703 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76380.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.76380.log.gz--verbose 2023-11-08T19:53:53.703 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.40585.log 2023-11-08T19:53:53.704 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61538.log 2023-11-08T19:53:53.704 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55919.log.gz 2023-11-08T19:53:53.704 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2023-11-08T19:53:53.704 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40585.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2023-11-08T19:53:53.705 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57733.log 2023-11-08T19:53:53.705 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61538.log.gz 2023-11-08T19:53:53.705 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65616.log 2023-11-08T19:53:53.706 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37925.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2023-11-08T19:53:53.706 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46918.log 2023-11-08T19:53:53.706 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57733.log.gz 2023-11-08T19:53:53.706 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45270.log 2023-11-08T19:53:53.707 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65616.log.gz 2023-11-08T19:53:53.707 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39109.log 2023-11-08T19:53:53.707 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46918.log.gz 2023-11-08T19:53:53.707 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79899.log 2023-11-08T19:53:53.708 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68949.log 2023-11-08T19:53:53.708 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45270.log.gz 2023-11-08T19:53:53.708 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39109.log.gz 2023-11-08T19:53:53.708 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2023-11-08T19:53:53.709 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79899.log.gz 2023-11-08T19:53:53.709 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40398.log 2023-11-08T19:53:53.709 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68949.log.gz 2023-11-08T19:53:53.710 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78896.log 2023-11-08T19:53:53.710 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2023-11-08T19:53:53.710 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53835.log 2023-11-08T19:53:53.710 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40398.log.gz 2023-11-08T19:53:53.711 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67131.log 2023-11-08T19:53:53.711 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78896.log.gz 2023-11-08T19:53:53.711 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2023-11-08T19:53:53.712 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53835.log.gz 2023-11-08T19:53:53.712 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2023-11-08T19:53:53.712 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67131.log.gz 2023-11-08T19:53:53.712 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52974.log 2023-11-08T19:53:53.713 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2023-11-08T19:53:53.713 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64620.log 2023-11-08T19:53:53.713 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2023-11-08T19:53:53.713 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44976.log 2023-11-08T19:53:53.714 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52974.log.gz 2023-11-08T19:53:53.714 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77729.log 2023-11-08T19:53:53.714 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64620.log.gz 2023-11-08T19:53:53.715 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53431.log 2023-11-08T19:53:53.715 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44976.log.gz 2023-11-08T19:53:53.715 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71169.log 2023-11-08T19:53:53.715 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77729.log.gz 2023-11-08T19:53:53.716 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80548.log 2023-11-08T19:53:53.716 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53431.log.gz 2023-11-08T19:53:53.716 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61622.log 2023-11-08T19:53:53.716 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71169.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.71169.log.gz-5 2023-11-08T19:53:53.717 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.35951.log 2023-11-08T19:53:53.717 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80548.log.gz 2023-11-08T19:53:53.717 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53297.log 2023-11-08T19:53:53.718 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.61622.log.gz 2023-11-08T19:53:53.718 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40997.log 2023-11-08T19:53:53.718 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35951.log: gzip 0.0%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.35951.log.gz/var/log/ceph/ceph-client.admin.70562.log 2023-11-08T19:53:53.718 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.719 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33482.log 2023-11-08T19:53:53.719 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53297.log.gz 2023-11-08T19:53:53.719 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40997.log.gz 2023-11-08T19:53:53.719 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35435.log 2023-11-08T19:53:53.720 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70562.log.gz 2023-11-08T19:53:53.720 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46983.log 2023-11-08T19:53:53.720 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33482.log.gz 2023-11-08T19:53:53.721 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55393.log 2023-11-08T19:53:53.721 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35435.log.gz 2023-11-08T19:53:53.721 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2023-11-08T19:53:53.721 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46983.log.gz 2023-11-08T19:53:53.722 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39599.log 2023-11-08T19:53:53.722 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55393.log.gz 2023-11-08T19:53:53.722 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54015.log 2023-11-08T19:53:53.722 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz 2023-11-08T19:53:53.723 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66830.log 2023-11-08T19:53:53.723 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39599.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39599.log.gz 2023-11-08T19:53:53.723 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33155.log 2023-11-08T19:53:53.723 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54015.log.gz 2023-11-08T19:53:53.724 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.66830.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39769.log 2023-11-08T19:53:53.724 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66830.log.gz 2023-11-08T19:53:53.724 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64056.log 2023-11-08T19:53:53.725 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33155.log.gz 2023-11-08T19:53:53.725 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56497.log 2023-11-08T19:53:53.725 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39769.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39769.log.gz 2023-11-08T19:53:53.725 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64560.log 2023-11-08T19:53:53.726 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64056.log.gz 2023-11-08T19:53:53.726 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57608.log 2023-11-08T19:53:53.726 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56497.log.gz 2023-11-08T19:53:53.726 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78923.log 2023-11-08T19:53:53.727 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64560.log.gz 2023-11-08T19:53:53.727 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44934.log 2023-11-08T19:53:53.727 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57608.log.gz 2023-11-08T19:53:53.728 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43530.log 2023-11-08T19:53:53.728 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78923.log.gz 2023-11-08T19:53:53.728 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73428.log 2023-11-08T19:53:53.728 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44934.log.gz 2023-11-08T19:53:53.729 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61686.log 2023-11-08T19:53:53.729 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43530.log.gz 2023-11-08T19:53:53.729 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55538.log 2023-11-08T19:53:53.729 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73428.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.73428.log.gz 2023-11-08T19:53:53.730 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71896.log 2023-11-08T19:53:53.730 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61686.log.gz 2023-11-08T19:53:53.730 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72210.log 2023-11-08T19:53:53.731 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55538.log.gz 2023-11-08T19:53:53.731 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49537.log 2023-11-08T19:53:53.731 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71896.log.gz 2023-11-08T19:53:53.731 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2023-11-08T19:53:53.732 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72210.log.gz 2023-11-08T19:53:53.732 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77799.log 2023-11-08T19:53:53.732 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49537.log.gz 2023-11-08T19:53:53.732 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66300.log 2023-11-08T19:53:53.733 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2023-11-08T19:53:53.733 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.77799.log: -- /var/log/ceph/ceph-client.admin.43683.log 2023-11-08T19:53:53.733 INFO:teuthology.orchestra.run.smithi196.stderr: 10.9% -- replaced with /var/log/ceph/ceph-client.admin.77799.log.gz 2023-11-08T19:53:53.734 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78247.log 2023-11-08T19:53:53.734 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66300.log.gz 2023-11-08T19:53:53.734 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56282.log 2023-11-08T19:53:53.734 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43683.log.gz 2023-11-08T19:53:53.735 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53449.log 2023-11-08T19:53:53.735 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78247.log.gz 2023-11-08T19:53:53.735 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2023-11-08T19:53:53.735 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56282.log.gz 2023-11-08T19:53:53.736 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57669.log 2023-11-08T19:53:53.736 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53449.log.gz 2023-11-08T19:53:53.736 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64881.log 2023-11-08T19:53:53.736 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2023-11-08T19:53:53.737 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71695.log 2023-11-08T19:53:53.737 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57669.log.gz 2023-11-08T19:53:53.737 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2023-11-08T19:53:53.738 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64881.log.gz 2023-11-08T19:53:53.738 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37087.log 2023-11-08T19:53:53.738 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71695.log.gz 2023-11-08T19:53:53.738 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2023-11-08T19:53:53.739 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2023-11-08T19:53:53.739 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2023-11-08T19:53:53.739 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37087.log.gz 2023-11-08T19:53:53.739 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41497.log 2023-11-08T19:53:53.740 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45861.log: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2023-11-08T19:53:53.740 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69723.log 2023-11-08T19:53:53.740 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2023-11-08T19:53:53.740 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2023-11-08T19:53:53.741 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41497.log.gz 2023-11-08T19:53:53.741 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58183.log 2023-11-08T19:53:53.741 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69723.log.gz 2023-11-08T19:53:53.742 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2023-11-08T19:53:53.742 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2023-11-08T19:53:53.742 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60777.log 2023-11-08T19:53:53.742 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58183.log.gz 2023-11-08T19:53:53.743 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51183.log 2023-11-08T19:53:53.743 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2023-11-08T19:53:53.743 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75633.log 2023-11-08T19:53:53.744 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60777.log: 26.6% -- replaced with /var/log/ceph/ceph-client.admin.60777.log.gz 2023-11-08T19:53:53.744 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38166.log 2023-11-08T19:53:53.744 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51183.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.51183.log.gz 2023-11-08T19:53:53.744 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60962.log 2023-11-08T19:53:53.745 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75633.log.gz 2023-11-08T19:53:53.745 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56950.log 2023-11-08T19:53:53.745 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38166.log.gz 2023-11-08T19:53:53.745 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2023-11-08T19:53:53.746 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60962.log.gz 2023-11-08T19:53:53.746 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49398.log 2023-11-08T19:53:53.746 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56950.log.gz 2023-11-08T19:53:53.747 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72762.log 2023-11-08T19:53:53.747 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51403.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2023-11-08T19:53:53.747 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.49398.log: -- /var/log/ceph/ceph-client.admin.69369.log 2023-11-08T19:53:53.747 INFO:teuthology.orchestra.run.smithi196.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.49398.log.gz 2023-11-08T19:53:53.748 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39412.log 2023-11-08T19:53:53.748 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72762.log.gz 2023-11-08T19:53:53.748 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2023-11-08T19:53:53.748 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69369.log.gz 2023-11-08T19:53:53.749 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43207.log 2023-11-08T19:53:53.749 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39412.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39412.log.gz 2023-11-08T19:53:53.749 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.38206.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35908.log 2023-11-08T19:53:53.749 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2023-11-08T19:53:53.750 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62461.log 2023-11-08T19:53:53.750 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43207.log.gz 2023-11-08T19:53:53.750 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61458.log 2023-11-08T19:53:53.750 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35908.log.gz 2023-11-08T19:53:53.751 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.62461.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55710.log 2023-11-08T19:53:53.751 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62461.log.gz 2023-11-08T19:53:53.751 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48641.log 2023-11-08T19:53:53.752 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61458.log.gz 2023-11-08T19:53:53.752 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.55710.log: --verbose -- /var/log/ceph/ceph-client.admin.79166.log 2023-11-08T19:53:53.752 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.55710.log.gz 2023-11-08T19:53:53.752 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65732.log 2023-11-08T19:53:53.753 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48641.log.gz 2023-11-08T19:53:53.753 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57272.log 2023-11-08T19:53:53.753 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79166.log.gz 2023-11-08T19:53:53.753 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47391.log 2023-11-08T19:53:53.754 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65732.log.gz 2023-11-08T19:53:53.754 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38895.log 2023-11-08T19:53:53.754 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57272.log.gz 2023-11-08T19:53:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51724.log 2023-11-08T19:53:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47391.log.gz 2023-11-08T19:53:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75361.log 2023-11-08T19:53:53.755 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38895.log.gz 2023-11-08T19:53:53.756 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35500.log 2023-11-08T19:53:53.756 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51724.log.gz 2023-11-08T19:53:53.756 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66747.log 2023-11-08T19:53:53.756 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75361.log.gz 2023-11-08T19:53:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76809.log 2023-11-08T19:53:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35500.log.gz 2023-11-08T19:53:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41017.log 2023-11-08T19:53:53.757 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66747.log: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.66747.log.gz 2023-11-08T19:53:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70817.log 2023-11-08T19:53:53.758 INFO:teuthology.orchestra.run.smithi196.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.76809.log.gz 2023-11-08T19:53:53.758 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.41017.log: -- /var/log/ceph/ceph-client.admin.53608.log 2023-11-08T19:53:53.759 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41017.log.gz 2023-11-08T19:53:53.759 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69471.log 2023-11-08T19:53:53.759 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50380.log 2023-11-08T19:53:53.759 INFO:teuthology.orchestra.run.smithi196.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.70817.log.gz 2023-11-08T19:53:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53608.log.gz 2023-11-08T19:53:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60234.log 2023-11-08T19:53:53.760 INFO:teuthology.orchestra.run.smithi196.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.69471.log.gz 2023-11-08T19:53:53.760 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2023-11-08T19:53:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50380.log.gz 2023-11-08T19:53:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2023-11-08T19:53:53.761 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60234.log.gz 2023-11-08T19:53:53.762 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75139.log 2023-11-08T19:53:53.762 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2023-11-08T19:53:53.762 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.49476.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48168.log 2023-11-08T19:53:53.762 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2023-11-08T19:53:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75913.log 2023-11-08T19:53:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75139.log.gz 2023-11-08T19:53:53.763 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72074.log 2023-11-08T19:53:53.763 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48168.log.gz 2023-11-08T19:53:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75913.log: /var/log/ceph/ceph-client.admin.56519.log 2023-11-08T19:53:53.764 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75913.log.gz 2023-11-08T19:53:53.764 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72074.log: /var/log/ceph/ceph-client.admin.49357.log 2023-11-08T19:53:53.764 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72074.log.gz 2023-11-08T19:53:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49634.log 2023-11-08T19:53:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56519.log.gz 2023-11-08T19:53:53.765 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55414.log 2023-11-08T19:53:53.766 INFO:teuthology.orchestra.run.smithi196.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.49357.log.gz 2023-11-08T19:53:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62676.log 2023-11-08T19:53:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49634.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.49634.log.gz 2023-11-08T19:53:53.766 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33530.log 2023-11-08T19:53:53.767 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55414.log.gz 2023-11-08T19:53:53.767 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40194.log 2023-11-08T19:53:53.767 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62676.log.gz 2023-11-08T19:53:53.767 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76977.log 2023-11-08T19:53:53.768 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33530.log.gz 2023-11-08T19:53:53.768 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53484.log 2023-11-08T19:53:53.768 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63187.log 2023-11-08T19:53:53.769 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40194.log.gz 2023-11-08T19:53:53.769 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76977.log: /var/log/ceph/ceph-client.admin.53484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78869.log 2023-11-08T19:53:53.769 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76977.log.gz 2023-11-08T19:53:53.769 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53484.log.gz 2023-11-08T19:53:53.770 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42597.log 2023-11-08T19:53:53.770 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63187.log.gz 2023-11-08T19:53:53.770 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55961.log 2023-11-08T19:53:53.771 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78869.log.gz 2023-11-08T19:53:53.771 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55514.log 2023-11-08T19:53:53.771 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42597.log.gz 2023-11-08T19:53:53.771 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67045.log 2023-11-08T19:53:53.772 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55961.log.gz 2023-11-08T19:53:53.772 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log 2023-11-08T19:53:53.772 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55514.log.gz 2023-11-08T19:53:53.772 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74257.log 2023-11-08T19:53:53.773 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67045.log.gz 2023-11-08T19:53:53.773 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log: /var/log/ceph/ceph-client.admin.35349.log 2023-11-08T19:53:53.773 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57690.log.gz 2023-11-08T19:53:53.773 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 2023-11-08T19:53:53.774 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74257.log.gz 2023-11-08T19:53:53.774 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81251.log 2023-11-08T19:53:53.774 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2023-11-08T19:53:53.775 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76956.log 2023-11-08T19:53:53.775 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2023-11-08T19:53:53.775 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2023-11-08T19:53:53.775 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81251.log.gz 2023-11-08T19:53:53.776 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76956.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-08T19:53:53.776 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76956.log.gz 2023-11-08T19:53:53.776 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69410.log 2023-11-08T19:53:53.777 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2023-11-08T19:53:53.777 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35024.log 2023-11-08T19:53:53.777 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.69410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60062.log 2023-11-08T19:53:53.777 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69410.log.gz 2023-11-08T19:53:53.778 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77644.log 2023-11-08T19:53:53.778 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35024.log.gz 2023-11-08T19:53:53.778 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54973.log 2023-11-08T19:53:53.778 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60062.log.gz 2023-11-08T19:53:53.779 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45249.log 2023-11-08T19:53:53.779 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69885.log 2023-11-08T19:53:53.779 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77644.log.gz 2023-11-08T19:53:53.779 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54973.log.gz 2023-11-08T19:53:53.780 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62223.log 2023-11-08T19:53:53.780 INFO:teuthology.orchestra.run.smithi196.stderr: 23.8% -- replaced with /var/log/ceph/ceph-client.admin.45249.log.gz 2023-11-08T19:53:53.780 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69569.log 2023-11-08T19:53:53.781 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69885.log.gz 2023-11-08T19:53:53.781 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62223.log.gz 2023-11-08T19:53:53.781 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58248.log 2023-11-08T19:53:53.781 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62547.log 2023-11-08T19:53:53.782 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79764.log 2023-11-08T19:53:53.782 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69569.log.gz 2023-11-08T19:53:53.782 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58248.log.gz 2023-11-08T19:53:53.782 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.62547.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57358.log 2023-11-08T19:53:53.783 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62547.log.gz 2023-11-08T19:53:53.783 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70103.log /var/log/ceph/ceph-client.admin.79764.log: 2023-11-08T19:53:53.783 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79764.log.gz 2023-11-08T19:53:53.784 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46832.log 2023-11-08T19:53:53.784 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57358.log.gz 2023-11-08T19:53:53.784 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33074.log 2023-11-08T19:53:53.784 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70103.log.gz 2023-11-08T19:53:53.785 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77622.log /var/log/ceph/ceph-client.admin.46832.log: 2023-11-08T19:53:53.785 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46832.log.gz 2023-11-08T19:53:53.785 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65272.log 2023-11-08T19:53:53.785 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33074.log.gz 2023-11-08T19:53:53.786 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.77622.log: -- /var/log/ceph/ceph-client.admin.81332.log 2023-11-08T19:53:53.786 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77622.log.gz 2023-11-08T19:53:53.786 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38981.log 2023-11-08T19:53:53.787 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65272.log.gz 2023-11-08T19:53:53.787 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33339.log 2023-11-08T19:53:53.787 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81332.log.gz 2023-11-08T19:53:53.787 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-11-08T19:53:53.788 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38981.log.gz 2023-11-08T19:53:53.788 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76935.log 2023-11-08T19:53:53.788 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33339.log.gz 2023-11-08T19:53:53.788 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.47219.log: --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2023-11-08T19:53:53.789 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-11-08T19:53:53.789 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.76935.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77450.log 2023-11-08T19:53:53.789 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76935.log.gz 2023-11-08T19:53:53.790 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68486.log 2023-11-08T19:53:53.790 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2023-11-08T19:53:53.790 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77450.log: /var/log/ceph/ceph-client.admin.68425.log 2023-11-08T19:53:53.790 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77450.log.gz 2023-11-08T19:53:53.791 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72805.log 2023-11-08T19:53:53.791 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68486.log.gz 2023-11-08T19:53:53.791 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.68425.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49799.log 2023-11-08T19:53:53.791 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68425.log.gz 2023-11-08T19:53:53.792 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73935.log 2023-11-08T19:53:53.792 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72805.log.gz 2023-11-08T19:53:53.792 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56476.log 2023-11-08T19:53:53.793 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49799.log.gz 2023-11-08T19:53:53.793 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53039.log 2023-11-08T19:53:53.793 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73935.log.gz 2023-11-08T19:53:53.793 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66980.log 2023-11-08T19:53:53.794 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56476.log.gz 2023-11-08T19:53:53.794 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2023-11-08T19:53:53.794 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53039.log.gz 2023-11-08T19:53:53.795 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42557.log 2023-11-08T19:53:53.795 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66980.log.gz 2023-11-08T19:53:53.795 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65697.log 2023-11-08T19:53:53.795 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2023-11-08T19:53:53.796 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37732.log 2023-11-08T19:53:53.796 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42557.log.gz 2023-11-08T19:53:53.796 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58377.log 2023-11-08T19:53:53.796 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65697.log.gz 2023-11-08T19:53:53.797 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80467.log 2023-11-08T19:53:53.797 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37732.log.gz 2023-11-08T19:53:53.797 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2023-11-08T19:53:53.798 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58377.log.gz 2023-11-08T19:53:53.798 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2023-11-08T19:53:53.798 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80467.log.gz 2023-11-08T19:53:53.798 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61025.log 2023-11-08T19:53:53.799 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2023-11-08T19:53:53.799 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2023-11-08T19:53:53.799 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2023-11-08T19:53:53.799 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79328.log 2023-11-08T19:53:53.800 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61025.log.gz 2023-11-08T19:53:53.800 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59256.log 2023-11-08T19:53:53.800 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2023-11-08T19:53:53.801 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52695.log 2023-11-08T19:53:53.801 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79328.log.gz 2023-11-08T19:53:53.801 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72848.log 2023-11-08T19:53:53.801 INFO:teuthology.orchestra.run.smithi196.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.59256.log.gz 2023-11-08T19:53:53.802 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69278.log 2023-11-08T19:53:53.802 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52695.log.gz 2023-11-08T19:53:53.802 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75301.log 2023-11-08T19:53:53.803 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72848.log.gz 2023-11-08T19:53:53.803 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66787.log 2023-11-08T19:53:53.803 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69278.log.gz 2023-11-08T19:53:53.803 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40500.log 2023-11-08T19:53:53.804 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75301.log.gz 2023-11-08T19:53:53.804 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2023-11-08T19:53:53.804 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66787.log.gz 2023-11-08T19:53:53.804 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49378.log 2023-11-08T19:53:53.805 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71916.log 2023-11-08T19:53:53.805 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40500.log.gz 2023-11-08T19:53:53.805 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2023-11-08T19:53:53.806 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.49378.log: --verbose -- /var/log/ceph/ceph-client.admin.69686.log 2023-11-08T19:53:53.806 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.49378.log.gz 2023-11-08T19:53:53.806 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.71916.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36092.log 2023-11-08T19:53:53.806 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71916.log.gz 2023-11-08T19:53:53.807 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53520.log 2023-11-08T19:53:53.807 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69686.log.gz/var/log/ceph/ceph-client.admin.36092.log: 2023-11-08T19:53:53.807 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36092.log.gz-5 2023-11-08T19:53:53.808 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.81441.log 2023-11-08T19:53:53.808 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75754.log 2023-11-08T19:53:53.808 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53520.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.53520.log.gz--verbose 2023-11-08T19:53:53.808 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.37977.log 2023-11-08T19:53:53.809 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81441.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81441.log.gz-5 2023-11-08T19:53:53.809 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.39225.log 2023-11-08T19:53:53.809 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75754.log.gz 2023-11-08T19:53:53.809 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49779.log 2023-11-08T19:53:53.810 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gz 2023-11-08T19:53:53.810 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55584.log 2023-11-08T19:53:53.810 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39225.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2023-11-08T19:53:53.810 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34110.log 2023-11-08T19:53:53.811 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49779.log.gz 2023-11-08T19:53:53.811 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45438.log 2023-11-08T19:53:53.811 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55584.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55584.log.gz-5 2023-11-08T19:53:53.812 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.63712.log 2023-11-08T19:53:53.812 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34110.log.gz 2023-11-08T19:53:53.812 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62998.log 2023-11-08T19:53:53.812 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45438.log.gz 2023-11-08T19:53:53.813 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63712.log: /var/log/ceph/ceph-client.admin.73827.log 2023-11-08T19:53:53.813 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63712.log.gz 2023-11-08T19:53:53.813 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-11-08T19:53:53.813 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62998.log.gz 2023-11-08T19:53:53.814 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77020.log 2023-11-08T19:53:53.814 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45375.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.73827.log: -- /var/log/ceph/ceph-client.admin.63106.log 2023-11-08T19:53:53.814 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73827.log.gz 2023-11-08T19:53:53.815 INFO:teuthology.orchestra.run.smithi196.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-11-08T19:53:53.815 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57208.log 2023-11-08T19:53:53.815 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77020.log.gz 2023-11-08T19:53:53.815 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.63106.log: -- /var/log/ceph/ceph-client.admin.39378.log 2023-11-08T19:53:53.816 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63106.log.gz 2023-11-08T19:53:53.816 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2023-11-08T19:53:53.816 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57208.log: 0.0%/var/log/ceph/ceph-client.admin.39378.log: -- replaced with /var/log/ceph/ceph-client.admin.57208.log.gz 2023-11-08T19:53:53.816 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54230.log 2023-11-08T19:53:53.817 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39378.log.gz 2023-11-08T19:53:53.817 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33895.log 2023-11-08T19:53:53.817 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2023-11-08T19:53:53.817 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47752.log 2023-11-08T19:53:53.818 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54230.log.gz 2023-11-08T19:53:53.818 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68098.log 2023-11-08T19:53:53.818 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33895.log.gz 2023-11-08T19:53:53.819 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67582.log 2023-11-08T19:53:53.819 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47752.log.gz 2023-11-08T19:53:53.819 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79494.log 2023-11-08T19:53:53.819 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68098.log.gz 2023-11-08T19:53:53.820 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.67582.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54935.log 2023-11-08T19:53:53.820 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67582.log.gz 2023-11-08T19:53:53.820 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34239.log 2023-11-08T19:53:53.821 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79494.log: /var/log/ceph/ceph-client.admin.54935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79494.log.gz 2023-11-08T19:53:53.821 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81305.log 2023-11-08T19:53:53.821 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.54935.log.gz 2023-11-08T19:53:53.821 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2023-11-08T19:53:53.822 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34239.log.gz 2023-11-08T19:53:53.822 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74580.log 2023-11-08T19:53:53.822 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81305.log.gz 2023-11-08T19:53:53.822 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2023-11-08T19:53:53.823 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2023-11-08T19:53:53.823 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39088.log 2023-11-08T19:53:53.823 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74580.log.gz 2023-11-08T19:53:53.823 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45714.log 2023-11-08T19:53:53.824 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2023-11-08T19:53:53.824 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49256.log 2023-11-08T19:53:53.824 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39088.log.gz 2023-11-08T19:53:53.825 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71229.log 2023-11-08T19:53:53.825 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45714.log.gz 2023-11-08T19:53:53.825 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2023-11-08T19:53:53.825 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49256.log.gz 2023-11-08T19:53:53.826 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-08T19:53:53.826 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71229.log.gz 2023-11-08T19:53:53.826 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59761.log 2023-11-08T19:53:53.826 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2023-11-08T19:53:53.827 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60470.log 2023-11-08T19:53:53.827 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56864.log 2023-11-08T19:53:53.827 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59761.log.gz 2023-11-08T19:53:53.827 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2023-11-08T19:53:53.828 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60470.log.gz 2023-11-08T19:53:53.828 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73079.log 2023-11-08T19:53:53.828 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56864.log.gz 2023-11-08T19:53:53.829 INFO:teuthology.orchestra.run.smithi196.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-08T19:53:53.829 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69140.log 2023-11-08T19:53:53.829 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2023-11-08T19:53:53.829 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59890.log 2023-11-08T19:53:53.830 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73079.log.gz 2023-11-08T19:53:53.830 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2023-11-08T19:53:53.830 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69140.log.gz 2023-11-08T19:53:53.830 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35715.log 2023-11-08T19:53:53.831 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59890.log.gz 2023-11-08T19:53:53.831 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50505.log 2023-11-08T19:53:53.831 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2023-11-08T19:53:53.832 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71815.log 2023-11-08T19:53:53.832 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35715.log.gz 2023-11-08T19:53:53.832 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63148.log 2023-11-08T19:53:53.832 INFO:teuthology.orchestra.run.smithi196.stderr: 22.7% -- replaced with /var/log/ceph/ceph-client.admin.50505.log.gz 2023-11-08T19:53:53.833 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48871.log 2023-11-08T19:53:53.833 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71815.log.gz 2023-11-08T19:53:53.833 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47656.log 2023-11-08T19:53:53.833 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63148.log.gz 2023-11-08T19:53:53.834 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2023-11-08T19:53:53.834 INFO:teuthology.orchestra.run.smithi196.stderr: 17.8% -- replaced with /var/log/ceph/ceph-client.admin.48871.log.gz 2023-11-08T19:53:53.834 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2023-11-08T19:53:53.835 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47656.log.gz 2023-11-08T19:53:53.835 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73265.log 2023-11-08T19:53:53.835 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2023-11-08T19:53:53.835 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65552.log 2023-11-08T19:53:53.836 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2023-11-08T19:53:53.836 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73265.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2023-11-08T19:53:53.836 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73265.log.gz 2023-11-08T19:53:53.837 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65036.log 2023-11-08T19:53:53.837 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65552.log.gz 2023-11-08T19:53:53.837 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68387.log 2023-11-08T19:53:53.837 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2023-11-08T19:53:53.838 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68617.log 2023-11-08T19:53:53.838 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65036.log.gz 2023-11-08T19:53:53.838 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33573.log 2023-11-08T19:53:53.839 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68387.log.gz 2023-11-08T19:53:53.839 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69843.log 2023-11-08T19:53:53.839 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68617.log.gz 2023-11-08T19:53:53.839 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33573.log: /var/log/ceph/ceph-client.admin.35004.log 2023-11-08T19:53:53.840 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33573.log.gz 2023-11-08T19:53:53.840 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2023-11-08T19:53:53.840 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69843.log.gz 2023-11-08T19:53:53.840 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74816.log 2023-11-08T19:53:53.841 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35004.log.gz 2023-11-08T19:53:53.841 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2023-11-08T19:53:53.841 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2023-11-08T19:53:53.841 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78115.log 2023-11-08T19:53:53.842 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74816.log.gz 2023-11-08T19:53:53.842 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75892.log 2023-11-08T19:53:53.842 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2023-11-08T19:53:53.843 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65337.log 2023-11-08T19:53:53.843 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78115.log.gz 2023-11-08T19:53:53.843 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2023-11-08T19:53:53.843 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75892.log: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.75892.log.gz 2023-11-08T19:53:53.844 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64458.log 2023-11-08T19:53:53.844 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65337.log.gz 2023-11-08T19:53:53.844 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70583.log 2023-11-08T19:53:53.844 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2023-11-08T19:53:53.845 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 2023-11-08T19:53:53.845 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64458.log.gz 2023-11-08T19:53:53.845 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70682.log 2023-11-08T19:53:53.845 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70583.log.gz 2023-11-08T19:53:53.846 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34153.log 2023-11-08T19:53:53.846 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2023-11-08T19:53:53.846 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48340.log 2023-11-08T19:53:53.847 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70682.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.70682.log.gz 2023-11-08T19:53:53.847 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61420.log 2023-11-08T19:53:53.847 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34153.log.gz 2023-11-08T19:53:53.847 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46113.log 2023-11-08T19:53:53.848 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48340.log.gz 2023-11-08T19:53:53.848 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40653.log 2023-11-08T19:53:53.848 INFO:teuthology.orchestra.run.smithi196.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.61420.log.gz 2023-11-08T19:53:53.848 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56605.log 2023-11-08T19:53:53.849 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46113.log.gz 2023-11-08T19:53:53.849 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.40653.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70062.log 2023-11-08T19:53:53.849 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40653.log.gz 2023-11-08T19:53:53.850 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2023-11-08T19:53:53.850 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56605.log.gz 2023-11-08T19:53:53.850 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.70062.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66203.log 2023-11-08T19:53:53.850 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70062.log.gz 2023-11-08T19:53:53.851 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41557.log 2023-11-08T19:53:53.851 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2023-11-08T19:53:53.851 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52652.log 2023-11-08T19:53:53.851 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66203.log.gz 2023-11-08T19:53:53.852 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2023-11-08T19:53:53.852 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41557.log.gz 2023-11-08T19:53:53.852 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75448.log 2023-11-08T19:53:53.852 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52652.log.gz 2023-11-08T19:53:53.853 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69221.log 2023-11-08T19:53:53.853 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40245.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2023-11-08T19:53:53.853 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73594.log 2023-11-08T19:53:53.853 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75448.log.gz 2023-11-08T19:53:53.854 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57315.log 2023-11-08T19:53:53.854 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69221.log.gz 2023-11-08T19:53:53.854 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54771.log 2023-11-08T19:53:53.855 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73594.log.gz 2023-11-08T19:53:53.855 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64840.log 2023-11-08T19:53:53.855 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57315.log.gz 2023-11-08T19:53:53.855 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54993.log 2023-11-08T19:53:53.855 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54771.log.gz 2023-11-08T19:53:53.856 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35137.log 2023-11-08T19:53:53.856 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64840.log.gz 2023-11-08T19:53:53.856 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69098.log 2023-11-08T19:53:53.857 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54993.log.gz 2023-11-08T19:53:53.857 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74601.log /var/log/ceph/ceph-client.admin.35137.log: 2023-11-08T19:53:53.857 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35137.log.gz 2023-11-08T19:53:53.857 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55175.log 2023-11-08T19:53:53.858 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69098.log.gz 2023-11-08T19:53:53.858 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40772.log 2023-11-08T19:53:53.858 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74601.log.gz 2023-11-08T19:53:53.858 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62309.log 2023-11-08T19:53:53.859 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55175.log.gz 2023-11-08T19:53:53.859 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58226.log 2023-11-08T19:53:53.859 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40772.log.gz 2023-11-08T19:53:53.859 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43037.log 2023-11-08T19:53:53.860 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62309.log.gz 2023-11-08T19:53:53.860 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.58226.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70352.log 2023-11-08T19:53:53.860 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58226.log.gz 2023-11-08T19:53:53.860 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60105.log 2023-11-08T19:53:53.861 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43037.log.gz 2023-11-08T19:53:53.861 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75321.log 2023-11-08T19:53:53.861 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70352.log.gz 2023-11-08T19:53:53.861 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50786.log 2023-11-08T19:53:53.862 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60105.log.gz 2023-11-08T19:53:53.862 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74214.log 2023-11-08T19:53:53.862 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75321.log.gz 2023-11-08T19:53:53.862 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2023-11-08T19:53:53.863 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50786.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50786.log.gz 2023-11-08T19:53:53.863 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.74214.log: --verbose -- /var/log/ceph/ceph-client.admin.61729.log 2023-11-08T19:53:53.863 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74214.log.gz 2023-11-08T19:53:53.864 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63884.log 2023-11-08T19:53:53.864 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2023-11-08T19:53:53.864 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60277.log 2023-11-08T19:53:53.864 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61729.log.gz 2023-11-08T19:53:53.865 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66483.log 2023-11-08T19:53:53.865 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63884.log.gz 2023-11-08T19:53:53.865 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65890.log 2023-11-08T19:53:53.865 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60277.log.gz 2023-11-08T19:53:53.866 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59172.log 2023-11-08T19:53:53.866 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66483.log.gz 2023-11-08T19:53:53.866 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40262.log 2023-11-08T19:53:53.866 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65890.log.gz 2023-11-08T19:53:53.867 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2023-11-08T19:53:53.867 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59172.log.gz 2023-11-08T19:53:53.867 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58140.log 2023-11-08T19:53:53.868 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40262.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40262.log.gz 2023-11-08T19:53:53.868 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61045.log 2023-11-08T19:53:53.868 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2023-11-08T19:53:53.868 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2023-11-08T19:53:53.869 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58140.log.gz 2023-11-08T19:53:53.869 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62633.log 2023-11-08T19:53:53.869 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61045.log.gz 2023-11-08T19:53:53.869 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52433.log 2023-11-08T19:53:53.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2023-11-08T19:53:53.870 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2023-11-08T19:53:53.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62633.log.gz 2023-11-08T19:53:53.871 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75734.log 2023-11-08T19:53:53.871 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52433.log.gz 2023-11-08T19:53:53.871 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.36153.log: --verbose -- /var/log/ceph/ceph-client.admin.60255.log 2023-11-08T19:53:53.871 INFO:teuthology.orchestra.run.smithi196.stderr: 6.3% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2023-11-08T19:53:53.872 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75931.log 2023-11-08T19:53:53.872 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75734.log.gz 2023-11-08T19:53:53.872 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36058.log 2023-11-08T19:53:53.872 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60255.log.gz 2023-11-08T19:53:53.873 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37345.log 2023-11-08T19:53:53.873 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75931.log: 56.2% -- replaced with /var/log/ceph/ceph-client.admin.75931.log.gz 2023-11-08T19:53:53.873 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67324.log 2023-11-08T19:53:53.873 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.36058.log.gz 2023-11-08T19:53:53.874 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77765.log /var/log/ceph/ceph-client.admin.37345.log: 2023-11-08T19:53:53.874 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37345.log.gz 2023-11-08T19:53:53.874 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72396.log 2023-11-08T19:53:53.874 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67324.log.gz 2023-11-08T19:53:53.875 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43513.log 2023-11-08T19:53:53.875 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77765.log.gz 2023-11-08T19:53:53.875 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65315.log 2023-11-08T19:53:53.875 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72396.log.gz 2023-11-08T19:53:53.876 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70419.log 2023-11-08T19:53:53.876 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43513.log.gz 2023-11-08T19:53:53.876 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38113.log 2023-11-08T19:53:53.876 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65315.log.gz 2023-11-08T19:53:53.877 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2023-11-08T19:53:53.877 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70419.log.gz 2023-11-08T19:53:53.877 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68404.log 2023-11-08T19:53:53.878 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38113.log.gz 2023-11-08T19:53:53.878 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2023-11-08T19:53:53.878 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2023-11-08T19:53:53.878 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39152.log 2023-11-08T19:53:53.879 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68404.log.gz 2023-11-08T19:53:53.879 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47931.log 2023-11-08T19:53:53.879 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2023-11-08T19:53:53.880 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79112.log 2023-11-08T19:53:53.880 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39152.log.gz 2023-11-08T19:53:53.880 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73347.log 2023-11-08T19:53:53.880 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47931.log.gz 2023-11-08T19:53:53.881 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79112.log: /var/log/ceph/ceph-client.admin.43632.log 2023-11-08T19:53:53.881 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79112.log.gz 2023-11-08T19:53:53.881 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73636.log 2023-11-08T19:53:53.881 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73347.log.gz 2023-11-08T19:53:53.882 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68034.log 2023-11-08T19:53:53.882 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2023-11-08T19:53:53.882 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2023-11-08T19:53:53.883 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73636.log.gz 2023-11-08T19:53:53.883 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.68034.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48383.log 2023-11-08T19:53:53.883 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68034.log.gz 2023-11-08T19:53:53.883 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57904.log 2023-11-08T19:53:53.884 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz 2023-11-08T19:53:53.884 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35306.log 2023-11-08T19:53:53.884 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48383.log.gz 2023-11-08T19:53:53.884 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68141.log 2023-11-08T19:53:53.885 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57904.log.gz 2023-11-08T19:53:53.885 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61580.log 2023-11-08T19:53:53.885 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35306.log.gz 2023-11-08T19:53:53.886 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56735.log 2023-11-08T19:53:53.886 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68141.log.gz 2023-11-08T19:53:53.886 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2023-11-08T19:53:53.886 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61580.log.gz 2023-11-08T19:53:53.887 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64698.log 2023-11-08T19:53:53.887 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56735.log.gz 2023-11-08T19:53:53.887 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58119.log 2023-11-08T19:53:53.887 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2023-11-08T19:53:53.888 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37539.log 2023-11-08T19:53:53.888 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64698.log.gz 2023-11-08T19:53:53.888 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67969.log 2023-11-08T19:53:53.889 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58119.log.gz 2023-11-08T19:53:53.889 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2023-11-08T19:53:53.889 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37539.log.gz 2023-11-08T19:53:53.889 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53413.log 2023-11-08T19:53:53.890 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67969.log.gz 2023-11-08T19:53:53.890 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44227.log 2023-11-08T19:53:53.890 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62245.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz--verbose 2023-11-08T19:53:53.890 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.58420.log 2023-11-08T19:53:53.891 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53413.log.gz 2023-11-08T19:53:53.891 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45459.log 2023-11-08T19:53:53.891 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44227.log.gz 2023-11-08T19:53:53.891 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40109.log 2023-11-08T19:53:53.892 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58420.log.gz 2023-11-08T19:53:53.892 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70122.log 2023-11-08T19:53:53.892 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45459.log.gz 2023-11-08T19:53:53.893 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56347.log 2023-11-08T19:53:53.893 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40109.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40109.log.gz 2023-11-08T19:53:53.893 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69590.log 2023-11-08T19:53:53.893 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70122.log.gz 2023-11-08T19:53:53.894 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68736.log 2023-11-08T19:53:53.894 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56347.log.gz 2023-11-08T19:53:53.894 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2023-11-08T19:53:53.895 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69590.log.gz 2023-11-08T19:53:53.895 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.68736.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2023-11-08T19:53:53.895 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68736.log.gz 2023-11-08T19:53:53.895 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45207.log 2023-11-08T19:53:53.896 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2023-11-08T19:53:53.896 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78545.log 2023-11-08T19:53:53.896 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2023-11-08T19:53:53.896 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69803.log 2023-11-08T19:53:53.897 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45207.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45207.log.gz 2023-11-08T19:53:53.897 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56047.log 2023-11-08T19:53:53.897 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78545.log.gz 2023-11-08T19:53:53.897 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2023-11-08T19:53:53.898 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69803.log.gz 2023-11-08T19:53:53.898 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39854.log 2023-11-08T19:53:53.898 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56047.log: 27.6% -- replaced with /var/log/ceph/ceph-client.admin.56047.log.gz 2023-11-08T19:53:53.898 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78788.log 2023-11-08T19:53:53.899 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2023-11-08T19:53:53.899 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51141.log 2023-11-08T19:53:53.899 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39854.log.gz 2023-11-08T19:53:53.899 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36201.log 2023-11-08T19:53:53.900 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78788.log.gz 2023-11-08T19:53:53.900 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67690.log 2023-11-08T19:53:53.900 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51141.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.51141.log.gz 2023-11-08T19:53:53.901 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40704.log 2023-11-08T19:53:53.901 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36201.log.gz 2023-11-08T19:53:53.901 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.67690.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log 2023-11-08T19:53:53.901 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67690.log.gz 2023-11-08T19:53:53.902 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69666.log 2023-11-08T19:53:53.902 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40704.log: 2.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.40704.log.gz-5 2023-11-08T19:53:53.902 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose /var/log/ceph/ceph-client.admin.47996.log: -- /var/log/ceph/ceph-client.admin.41297.log 2023-11-08T19:53:53.903 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2023-11-08T19:53:53.903 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43717.log 2023-11-08T19:53:53.903 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69666.log.gz 2023-11-08T19:53:53.903 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70023.log 2023-11-08T19:53:53.904 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2023-11-08T19:53:53.904 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2023-11-08T19:53:53.904 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43717.log.gz 2023-11-08T19:53:53.904 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.70023.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2023-11-08T19:53:53.905 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70023.log.gz 2023-11-08T19:53:53.905 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72719.log 2023-11-08T19:53:53.905 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2023-11-08T19:53:53.905 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2023-11-08T19:53:53.906 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2023-11-08T19:53:53.906 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49557.log 2023-11-08T19:53:53.906 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72719.log.gz 2023-11-08T19:53:53.907 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68987.log 2023-11-08T19:53:53.907 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2023-11-08T19:53:53.907 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72248.log 2023-11-08T19:53:53.907 INFO:teuthology.orchestra.run.smithi196.stderr: 8.3% -- replaced with /var/log/ceph/ceph-client.admin.49557.log.gz 2023-11-08T19:53:53.907 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2023-11-08T19:53:53.908 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68987.log: /var/log/ceph/ceph-client.admin.72248.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.34664.log -- replaced with /var/log/ceph/ceph-client.admin.68987.log.gz 2023-11-08T19:53:53.908 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.908 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72248.log.gz 2023-11-08T19:53:53.909 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37431.log 2023-11-08T19:53:53.909 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40893.log: gzip -5 56.6%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz/var/log/ceph/ceph-client.admin.76724.log 2023-11-08T19:53:53.909 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.909 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34664.log.gz 2023-11-08T19:53:53.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74795.log 2023-11-08T19:53:53.910 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37431.log.gz 2023-11-08T19:53:53.910 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76015.log 2023-11-08T19:53:53.910 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76724.log.gz 2023-11-08T19:53:53.911 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38788.log 2023-11-08T19:53:53.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74795.log.gz 2023-11-08T19:53:53.911 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69389.log 2023-11-08T19:53:53.912 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76015.log.gz 2023-11-08T19:53:53.912 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78088.log 2023-11-08T19:53:53.912 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38788.log.gz 2023-11-08T19:53:53.912 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53396.log 2023-11-08T19:53:53.913 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69389.log.gz 2023-11-08T19:53:53.913 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33128.log 2023-11-08T19:53:53.913 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78088.log.gz 2023-11-08T19:53:53.913 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56004.log 2023-11-08T19:53:53.914 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53396.log.gz 2023-11-08T19:53:53.914 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2023-11-08T19:53:53.914 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33128.log.gz 2023-11-08T19:53:53.914 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69335.log 2023-11-08T19:53:53.915 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56004.log.gz 2023-11-08T19:53:53.915 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71049.log 2023-11-08T19:53:53.915 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2023-11-08T19:53:53.916 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43496.log 2023-11-08T19:53:53.916 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69335.log.gz 2023-11-08T19:53:53.916 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61065.log 2023-11-08T19:53:53.916 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71049.log.gz 2023-11-08T19:53:53.917 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40330.log 2023-11-08T19:53:53.917 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43496.log.gz 2023-11-08T19:53:53.917 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65165.log 2023-11-08T19:53:53.917 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61065.log.gz 2023-11-08T19:53:53.918 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51162.log 2023-11-08T19:53:53.918 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40330.log.gz 2023-11-08T19:53:53.918 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62848.log 2023-11-08T19:53:53.919 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65165.log.gz 2023-11-08T19:53:53.919 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80846.log 2023-11-08T19:53:53.919 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51162.log.gz 2023-11-08T19:53:53.919 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2023-11-08T19:53:53.920 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62848.log.gz 2023-11-08T19:53:53.920 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48808.log 2023-11-08T19:53:53.920 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80846.log.gz 2023-11-08T19:53:53.921 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2023-11-08T19:53:53.921 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2023-11-08T19:53:53.921 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2023-11-08T19:53:53.921 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48808.log.gz 2023-11-08T19:53:53.922 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62202.log /var/log/ceph/ceph-client.admin.35930.log: 2023-11-08T19:53:53.922 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2023-11-08T19:53:53.922 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59718.log 2023-11-08T19:53:53.922 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47675.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2023-11-08T19:53:53.923 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41357.log 2023-11-08T19:53:53.923 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62202.log.gz 2023-11-08T19:53:53.923 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35758.log 2023-11-08T19:53:53.923 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59718.log.gz 2023-11-08T19:53:53.924 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35887.log 2023-11-08T19:53:53.924 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41357.log.gz 2023-11-08T19:53:53.924 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.35758.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49273.log 2023-11-08T19:53:53.925 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35758.log.gz 2023-11-08T19:53:53.925 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2023-11-08T19:53:53.925 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35887.log.gz 2023-11-08T19:53:53.925 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2023-11-08T19:53:53.925 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49273.log.gz 2023-11-08T19:53:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64720.log 2023-11-08T19:53:53.926 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2023-11-08T19:53:53.926 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61357.log 2023-11-08T19:53:53.927 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2023-11-08T19:53:53.927 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37861.log 2023-11-08T19:53:53.927 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64720.log.gz 2023-11-08T19:53:53.927 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.61357.log: -- /var/log/ceph/ceph-client.admin.67346.log 2023-11-08T19:53:53.928 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61357.log.gz 2023-11-08T19:53:53.928 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68334.log 2023-11-08T19:53:53.928 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37861.log.gz 2023-11-08T19:53:53.928 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50194.log 2023-11-08T19:53:53.929 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67346.log.gz 2023-11-08T19:53:53.929 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2023-11-08T19:53:53.929 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68334.log.gz 2023-11-08T19:53:53.929 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2023-11-08T19:53:53.930 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50194.log: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.50194.log.gz 2023-11-08T19:53:53.930 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73099.log 2023-11-08T19:53:53.930 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2023-11-08T19:53:53.930 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53712.log 2023-11-08T19:53:53.931 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2023-11-08T19:53:53.931 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41157.log 2023-11-08T19:53:53.931 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73099.log.gz 2023-11-08T19:53:53.932 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67496.log 2023-11-08T19:53:53.932 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53712.log.gz 2023-11-08T19:53:53.932 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.41157.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55328.log 2023-11-08T19:53:53.932 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41157.log.gz 2023-11-08T19:53:53.933 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77493.log 2023-11-08T19:53:53.933 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67496.log.gz 2023-11-08T19:53:53.933 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36958.log 2023-11-08T19:53:53.933 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55328.log.gz 2023-11-08T19:53:53.934 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68870.log 2023-11-08T19:53:53.934 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77493.log.gz 2023-11-08T19:53:53.934 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78653.log 2023-11-08T19:53:53.934 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36958.log.gz 2023-11-08T19:53:53.935 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67518.log 2023-11-08T19:53:53.935 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68870.log.gz 2023-11-08T19:53:53.935 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62740.log 2023-11-08T19:53:53.935 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78653.log.gz 2023-11-08T19:53:53.936 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70541.log 2023-11-08T19:53:53.936 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67518.log.gz 2023-11-08T19:53:53.936 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55849.log 2023-11-08T19:53:53.936 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62740.log.gz 2023-11-08T19:53:53.937 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2023-11-08T19:53:53.937 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70541.log.gz 2023-11-08T19:53:53.937 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49336.log 2023-11-08T19:53:53.937 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55849.log.gz 2023-11-08T19:53:53.938 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65444.log /var/log/ceph/ceph-client.admin.36293.log: 2023-11-08T19:53:53.938 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2023-11-08T19:53:53.938 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54466.log 2023-11-08T19:53:53.938 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49336.log.gz 2023-11-08T19:53:53.939 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63970.log 2023-11-08T19:53:53.939 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65444.log.gz 2023-11-08T19:53:53.939 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75384.log 2023-11-08T19:53:53.939 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54466.log.gz 2023-11-08T19:53:53.940 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2023-11-08T19:53:53.940 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63970.log.gz 2023-11-08T19:53:53.940 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.75384.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69180.log 2023-11-08T19:53:53.940 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75384.log.gz 2023-11-08T19:53:53.941 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78680.log 2023-11-08T19:53:53.941 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2023-11-08T19:53:53.941 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76101.log 2023-11-08T19:53:53.941 INFO:teuthology.orchestra.run.smithi196.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.69180.log.gz 2023-11-08T19:53:53.942 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65143.log 2023-11-08T19:53:53.942 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78680.log.gz 2023-11-08T19:53:53.942 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71270.log 2023-11-08T19:53:53.943 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76101.log.gz 2023-11-08T19:53:53.943 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66646.log 2023-11-08T19:53:53.943 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65143.log.gz 2023-11-08T19:53:53.943 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40041.log 2023-11-08T19:53:53.944 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71270.log.gz 2023-11-08T19:53:53.944 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70238.log 2023-11-08T19:53:53.944 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66646.log.gz 2023-11-08T19:53:53.944 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76595.log 2023-11-08T19:53:53.945 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40041.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40041.log.gz 2023-11-08T19:53:53.945 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42277.log 2023-11-08T19:53:53.945 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70238.log.gz 2023-11-08T19:53:53.945 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63271.log 2023-11-08T19:53:53.946 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76595.log.gz 2023-11-08T19:53:53.946 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63523.log 2023-11-08T19:53:53.946 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42277.log.gz 2023-11-08T19:53:53.946 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72525.log 2023-11-08T19:53:53.947 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63271.log.gz 2023-11-08T19:53:53.947 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39429.log 2023-11-08T19:53:53.947 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63523.log.gz 2023-11-08T19:53:53.947 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71311.log 2023-11-08T19:53:53.948 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72525.log.gz 2023-11-08T19:53:53.948 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2023-11-08T19:53:53.948 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39429.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39429.log.gz 2023-11-08T19:53:53.949 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2023-11-08T19:53:53.949 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71311.log.gz 2023-11-08T19:53:53.949 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76359.log 2023-11-08T19:53:53.949 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2023-11-08T19:53:53.949 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54531.log 2023-11-08T19:53:53.950 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2023-11-08T19:53:53.950 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.76359.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53950.log 2023-11-08T19:53:53.950 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76359.log.gz 2023-11-08T19:53:53.951 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62697.log 2023-11-08T19:53:53.951 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54531.log.gz 2023-11-08T19:53:53.951 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70179.log 2023-11-08T19:53:53.951 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53950.log.gz 2023-11-08T19:53:53.952 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2023-11-08T19:53:53.952 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62697.log.gz 2023-11-08T19:53:53.952 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70179.log.gz 2023-11-08T19:53:53.952 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79981.log 2023-11-08T19:53:53.953 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63927.log 2023-11-08T19:53:53.953 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2023-11-08T19:53:53.953 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63586.log 2023-11-08T19:53:53.954 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79981.log.gz 2023-11-08T19:53:53.954 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40755.log 2023-11-08T19:53:53.954 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63927.log.gz 2023-11-08T19:53:53.954 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63313.log 2023-11-08T19:53:53.955 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63586.log.gz 2023-11-08T19:53:53.955 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73550.log 2023-11-08T19:53:53.955 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40755.log.gz 2023-11-08T19:53:53.955 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2023-11-08T19:53:53.956 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63313.log.gz 2023-11-08T19:53:53.956 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.73550.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52673.log 2023-11-08T19:53:53.956 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73550.log.gz 2023-11-08T19:53:53.956 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73020.log 2023-11-08T19:53:53.957 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2023-11-08T19:53:53.957 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37603.log 2023-11-08T19:53:53.957 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52673.log.gz 2023-11-08T19:53:53.957 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72611.log 2023-11-08T19:53:53.958 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73020.log.gz 2023-11-08T19:53:53.958 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77171.log 2023-11-08T19:53:53.958 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37603.log.gz 2023-11-08T19:53:53.959 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80170.log 2023-11-08T19:53:53.959 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72611.log.gz 2023-11-08T19:53:53.959 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75993.log 2023-11-08T19:53:53.959 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77171.log.gz 2023-11-08T19:53:53.960 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.80170.log: --verbose -- /var/log/ceph/ceph-client.admin.79220.log 2023-11-08T19:53:53.960 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80170.log.gz 2023-11-08T19:53:53.960 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64799.log 2023-11-08T19:53:53.960 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75993.log.gz 2023-11-08T19:53:53.961 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50277.log 2023-11-08T19:53:53.961 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79220.log.gz 2023-11-08T19:53:53.961 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44787.log 2023-11-08T19:53:53.961 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64799.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.64799.log.gz 2023-11-08T19:53:53.962 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68163.log 2023-11-08T19:53:53.962 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50277.log.gz 2023-11-08T19:53:53.962 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39045.log /var/log/ceph/ceph-client.admin.44787.log: 2023-11-08T19:53:53.962 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44787.log.gz 2023-11-08T19:53:53.963 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45606.log 2023-11-08T19:53:53.963 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68163.log.gz 2023-11-08T19:53:53.963 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log 2023-11-08T19:53:53.963 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39045.log.gz 2023-11-08T19:53:53.964 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2023-11-08T19:53:53.964 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45606.log.gz 2023-11-08T19:53:53.964 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37109.log: /var/log/ceph/ceph-client.admin.50881.log 2023-11-08T19:53:53.965 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37109.log.gz 2023-11-08T19:53:53.965 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60983.log 2023-11-08T19:53:53.965 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2023-11-08T19:53:53.965 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71835.log 2023-11-08T19:53:53.966 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2023-11-08T19:53:53.966 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.60983.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44913.log 2023-11-08T19:53:53.966 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60983.log.gz 2023-11-08T19:53:53.966 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80089.log 2023-11-08T19:53:53.967 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71835.log.gz 2023-11-08T19:53:53.967 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67367.log 2023-11-08T19:53:53.967 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44913.log.gz 2023-11-08T19:53:53.967 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78599.log 2023-11-08T19:53:53.968 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80089.log.gz 2023-11-08T19:53:53.968 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67367.log: /var/log/ceph/ceph-client.admin.54681.log 2023-11-08T19:53:53.968 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67367.log.gz 2023-11-08T19:53:53.968 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72783.log 2023-11-08T19:53:53.969 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78599.log.gz 2023-11-08T19:53:53.969 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2023-11-08T19:53:53.969 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54681.log.gz 2023-11-08T19:53:53.969 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60700.log 2023-11-08T19:53:53.970 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72783.log.gz 2023-11-08T19:53:53.970 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81197.log 2023-11-08T19:53:53.970 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2023-11-08T19:53:53.970 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54144.log 2023-11-08T19:53:53.971 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60700.log.gz 2023-11-08T19:53:53.971 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35478.log 2023-11-08T19:53:53.971 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81197.log.gz 2023-11-08T19:53:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70295.log 2023-11-08T19:53:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54144.log.gz 2023-11-08T19:53:53.972 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79818.log 2023-11-08T19:53:53.972 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35478.log.gz 2023-11-08T19:53:53.973 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2023-11-08T19:53:53.973 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70295.log.gz 2023-11-08T19:53:53.973 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77235.log 2023-11-08T19:53:53.973 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79818.log.gz 2023-11-08T19:53:53.974 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47953.log 2023-11-08T19:53:53.974 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46533.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz/var/log/ceph/ceph-client.admin.77235.log: 2023-11-08T19:53:53.974 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64250.log 2023-11-08T19:53:53.974 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77235.log.gz 2023-11-08T19:53:53.975 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.47953.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76488.log 2023-11-08T19:53:53.975 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47953.log.gz 2023-11-08T19:53:53.975 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73221.log 2023-11-08T19:53:53.975 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64250.log.gz 2023-11-08T19:53:53.976 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71465.log 2023-11-08T19:53:53.976 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76488.log.gz 2023-11-08T19:53:53.976 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69927.log 2023-11-08T19:53:53.976 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73221.log.gz 2023-11-08T19:53:53.977 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2023-11-08T19:53:53.977 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71465.log.gz 2023-11-08T19:53:53.977 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2023-11-08T19:53:53.978 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69927.log.gz 2023-11-08T19:53:53.978 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2023-11-08T19:53:53.978 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2023-11-08T19:53:53.978 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2023-11-08T19:53:53.979 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46386.log: gzip -5 --verbose -- 22.7%/var/log/ceph/ceph-client.admin.71795.log -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2023-11-08T19:53:53.979 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:53.979 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50646.log: 1.2%/var/log/ceph/ceph-client.admin.52759.log: -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2023-11-08T19:53:53.979 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59954.log 2023-11-08T19:53:53.980 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2023-11-08T19:53:53.980 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55787.log 2023-11-08T19:53:53.980 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71795.log.gz 2023-11-08T19:53:53.981 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48850.log 2023-11-08T19:53:53.981 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59954.log.gz 2023-11-08T19:53:53.981 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50256.log 2023-11-08T19:53:53.981 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55787.log.gz 2023-11-08T19:53:53.982 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68522.log 2023-11-08T19:53:53.982 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48850.log.gz 2023-11-08T19:53:53.982 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58334.log 2023-11-08T19:53:53.982 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50256.log.gz 2023-11-08T19:53:53.983 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59868.log 2023-11-08T19:53:53.983 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68522.log.gz 2023-11-08T19:53:53.983 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68012.log 2023-11-08T19:53:53.984 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58334.log.gz 2023-11-08T19:53:53.984 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2023-11-08T19:53:53.984 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59868.log.gz 2023-11-08T19:53:53.984 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77386.log 2023-11-08T19:53:53.985 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68012.log.gz 2023-11-08T19:53:53.985 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34682.log 2023-11-08T19:53:53.985 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2023-11-08T19:53:53.986 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55689.log 2023-11-08T19:53:53.986 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77386.log.gz 2023-11-08T19:53:53.986 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74967.log 2023-11-08T19:53:53.986 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34682.log.gz 2023-11-08T19:53:53.987 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75203.log 2023-11-08T19:53:53.987 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55689.log.gz 2023-11-08T19:53:53.987 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48576.log 2023-11-08T19:53:53.987 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74967.log.gz 2023-11-08T19:53:53.988 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62051.log 2023-11-08T19:53:53.988 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75203.log.gz 2023-11-08T19:53:53.988 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60577.log 2023-11-08T19:53:53.989 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48576.log.gz 2023-11-08T19:53:53.989 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39667.log 2023-11-08T19:53:53.989 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62051.log.gz 2023-11-08T19:53:53.989 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54552.log 2023-11-08T19:53:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60577.log.gz 2023-11-08T19:53:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69703.log 2023-11-08T19:53:53.990 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39667.log.gz 2023-11-08T19:53:53.991 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54574.log 2023-11-08T19:53:53.991 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54552.log.gz 2023-11-08T19:53:53.991 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53908.log 2023-11-08T19:53:53.991 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69703.log.gz 2023-11-08T19:53:53.992 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50584.log 2023-11-08T19:53:53.992 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54574.log.gz 2023-11-08T19:53:53.992 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71424.log 2023-11-08T19:53:53.993 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53908.log.gz 2023-11-08T19:53:53.993 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2023-11-08T19:53:53.993 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50584.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.50584.log.gz 2023-11-08T19:53:53.994 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74128.log 2023-11-08T19:53:53.994 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81062.log 2023-11-08T19:53:53.994 INFO:teuthology.orchestra.run.smithi196.stderr: 56.0% -- replaced with /var/log/ceph/ceph-client.admin.71424.log.gz 2023-11-08T19:53:53.994 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2023-11-08T19:53:53.995 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81008.log 2023-11-08T19:53:53.995 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56154.log 2023-11-08T19:53:53.995 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74128.log.gz 2023-11-08T19:53:53.996 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81062.log.gz 2023-11-08T19:53:53.996 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74150.log 2023-11-08T19:53:53.996 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81008.log.gz 2023-11-08T19:53:53.996 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2023-11-08T19:53:53.997 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56154.log.gz 2023-11-08T19:53:53.997 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2023-11-08T19:53:53.997 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74150.log.gz 2023-11-08T19:53:53.997 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2023-11-08T19:53:53.998 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2023-11-08T19:53:53.998 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2023-11-08T19:53:53.998 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2023-11-08T19:53:53.999 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2023-11-08T19:53:53.999 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2023-11-08T19:53:53.999 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39888.log 2023-11-08T19:53:53.999 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40534.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2023-11-08T19:53:54.000 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71250.log 2023-11-08T19:53:54.000 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2023-11-08T19:53:54.000 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60617.log 2023-11-08T19:53:54.000 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39888.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39888.log.gz 2023-11-08T19:53:54.001 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77472.log 2023-11-08T19:53:54.001 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71250.log.gz 2023-11-08T19:53:54.001 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60557.log 2023-11-08T19:53:54.002 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60617.log.gz 2023-11-08T19:53:54.002 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79521.log 2023-11-08T19:53:54.002 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77472.log.gz 2023-11-08T19:53:54.002 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67066.log 2023-11-08T19:53:54.003 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60557.log: 27.6% -- replaced with /var/log/ceph/ceph-client.admin.60557.log.gz 2023-11-08T19:53:54.003 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48490.log 2023-11-08T19:53:54.003 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79521.log.gz 2023-11-08T19:53:54.003 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68849.log 2023-11-08T19:53:54.004 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67066.log.gz 2023-11-08T19:53:54.004 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72418.log 2023-11-08T19:53:54.004 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48490.log.gz 2023-11-08T19:53:54.004 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65380.log 2023-11-08T19:53:54.005 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68849.log.gz 2023-11-08T19:53:54.005 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67948.log 2023-11-08T19:53:54.005 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72418.log.gz 2023-11-08T19:53:54.005 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65380.log: /var/log/ceph/ceph-client.admin.34447.log 2023-11-08T19:53:54.006 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65380.log.gz 2023-11-08T19:53:54.006 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.67948.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38809.log 2023-11-08T19:53:54.006 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67948.log.gz 2023-11-08T19:53:54.007 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2023-11-08T19:53:54.007 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34447.log.gz 2023-11-08T19:53:54.007 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76870.log 2023-11-08T19:53:54.007 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38809.log.gz 2023-11-08T19:53:54.008 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63648.log 2023-11-08T19:53:54.008 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2023-11-08T19:53:54.008 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68807.log 2023-11-08T19:53:54.008 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76870.log.gz 2023-11-08T19:53:54.009 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.63648.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59633.log 2023-11-08T19:53:54.009 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63648.log.gz 2023-11-08T19:53:54.009 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61130.log 2023-11-08T19:53:54.010 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68807.log.gz 2023-11-08T19:53:54.010 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59216.log 2023-11-08T19:53:54.010 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59633.log: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.59633.log.gz 2023-11-08T19:53:54.010 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73469.log 2023-11-08T19:53:54.011 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61130.log.gz 2023-11-08T19:53:54.011 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79301.log 2023-11-08T19:53:54.011 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59216.log.gz 2023-11-08T19:53:54.011 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55494.log 2023-11-08T19:53:54.012 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73469.log.gz 2023-11-08T19:53:54.012 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39956.log 2023-11-08T19:53:54.012 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79301.log.gz 2023-11-08T19:53:54.013 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69512.log 2023-11-08T19:53:54.013 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55494.log.gz 2023-11-08T19:53:54.013 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51083.log 2023-11-08T19:53:54.013 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39956.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39956.log.gz 2023-11-08T19:53:54.014 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.69512.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log 2023-11-08T19:53:54.014 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69512.log.gz 2023-11-08T19:53:54.014 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.51083.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2023-11-08T19:53:54.014 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51083.log.gz 2023-11-08T19:53:54.015 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72654.log 2023-11-08T19:53:54.015 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2023-11-08T19:53:54.015 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61793.log 2023-11-08T19:53:54.016 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2023-11-08T19:53:54.016 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72654.log: /var/log/ceph/ceph-client.admin.49098.log 2023-11-08T19:53:54.016 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72654.log.gz 2023-11-08T19:53:54.016 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61793.log: /var/log/ceph/ceph-client.admin.77300.log 2023-11-08T19:53:54.017 INFO:teuthology.orchestra.run.smithi196.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.61793.log.gz 2023-11-08T19:53:54.017 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.49098.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56885.log 2023-11-08T19:53:54.017 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2023-11-08T19:53:54.017 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42037.log 2023-11-08T19:53:54.018 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77300.log.gz 2023-11-08T19:53:54.018 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41057.log 2023-11-08T19:53:54.018 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56885.log.gz 2023-11-08T19:53:54.019 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59825.log 2023-11-08T19:53:54.019 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42037.log.gz 2023-11-08T19:53:54.019 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41057.log.gz 2023-11-08T19:53:54.019 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53254.log 2023-11-08T19:53:54.020 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.59825.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73529.log 2023-11-08T19:53:54.020 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59825.log.gz 2023-11-08T19:53:54.020 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70399.log 2023-11-08T19:53:54.021 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53254.log.gz 2023-11-08T19:53:54.021 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66765.log 2023-11-08T19:53:54.021 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73529.log.gz 2023-11-08T19:53:54.021 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log 2023-11-08T19:53:54.022 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70399.log.gz 2023-11-08T19:53:54.022 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53677.log 2023-11-08T19:53:54.022 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66765.log.gz 2023-11-08T19:53:54.023 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52089.log: /var/log/ceph/ceph-client.admin.77042.log 2023-11-08T19:53:54.023 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52089.log.gz 2023-11-08T19:53:54.023 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62073.log 2023-11-08T19:53:54.023 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53677.log.gz 2023-11-08T19:53:54.024 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65079.log 2023-11-08T19:53:54.024 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77042.log.gz 2023-11-08T19:53:54.024 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68292.log 2023-11-08T19:53:54.024 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62073.log.gz 2023-11-08T19:53:54.025 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35457.log 2023-11-08T19:53:54.025 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65079.log.gz 2023-11-08T19:53:54.025 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.68292.log: --verbose -- /var/log/ceph/ceph-client.admin.76230.log 2023-11-08T19:53:54.026 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68292.log.gz 2023-11-08T19:53:54.026 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48469.log 2023-11-08T19:53:54.026 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35457.log.gz 2023-11-08T19:53:54.026 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41857.log 2023-11-08T19:53:54.027 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76230.log.gz 2023-11-08T19:53:54.027 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53017.log 2023-11-08T19:53:54.027 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48469.log.gz 2023-11-08T19:53:54.027 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65769.log 2023-11-08T19:53:54.028 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41857.log.gz 2023-11-08T19:53:54.028 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51221.log 2023-11-08T19:53:54.028 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53017.log.gz 2023-11-08T19:53:54.029 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47871.log 2023-11-08T19:53:54.029 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65769.log.gz 2023-11-08T19:53:54.029 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51221.log: /var/log/ceph/ceph-client.admin.38056.log 2023-11-08T19:53:54.029 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.51221.log.gz 2023-11-08T19:53:54.030 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62159.log 2023-11-08T19:53:54.030 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47871.log.gz 2023-11-08T19:53:54.030 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2023-11-08T19:53:54.031 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2023-11-08T19:53:54.031 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51424.log 2023-11-08T19:53:54.031 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62159.log.gz 2023-11-08T19:53:54.031 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2023-11-08T19:53:54.032 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2023-11-08T19:53:54.032 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69763.log 2023-11-08T19:53:54.032 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51424.log.gz 2023-11-08T19:53:54.032 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42297.log 2023-11-08T19:53:54.033 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50129.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2023-11-08T19:53:54.033 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80954.log 2023-11-08T19:53:54.033 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69763.log.gz 2023-11-08T19:53:54.034 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log 2023-11-08T19:53:54.034 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42297.log.gz 2023-11-08T19:53:54.034 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33551.log 2023-11-08T19:53:54.034 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80954.log.gz 2023-11-08T19:53:54.035 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37388.log: /var/log/ceph/ceph-client.admin.57380.log 2023-11-08T19:53:54.035 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37388.log.gz 2023-11-08T19:53:54.037 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70081.log 2023-11-08T19:53:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33551.log.gz 2023-11-08T19:53:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57925.log 2023-11-08T19:53:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57380.log.gz 2023-11-08T19:53:54.038 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2023-11-08T19:53:54.039 INFO:teuthology.orchestra.run.smithi196.stderr: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.70081.log.gz 2023-11-08T19:53:54.039 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68206.log 2023-11-08T19:53:54.039 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57925.log.gz 2023-11-08T19:53:54.040 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67432.log 2023-11-08T19:53:54.040 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48891.log: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2023-11-08T19:53:54.040 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81278.log 2023-11-08T19:53:54.040 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68206.log.gz 2023-11-08T19:53:54.041 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79548.log 2023-11-08T19:53:54.041 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67432.log.gz 2023-11-08T19:53:54.041 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34328.log 2023-11-08T19:53:54.042 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81278.log.gz 2023-11-08T19:53:54.042 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62719.log 2023-11-08T19:53:54.042 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79548.log.gz 2023-11-08T19:53:54.043 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64013.log 2023-11-08T19:53:54.043 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34328.log.gz 2023-11-08T19:53:54.043 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62826.log 2023-11-08T19:53:54.043 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62719.log.gz 2023-11-08T19:53:54.044 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77748.log 2023-11-08T19:53:54.107 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64013.log.gz 2023-11-08T19:53:54.108 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68313.log 2023-11-08T19:53:54.108 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62826.log.gz 2023-11-08T19:53:54.108 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60298.log 2023-11-08T19:53:54.109 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77748.log.gz 2023-11-08T19:53:54.109 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2023-11-08T19:53:54.109 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68313.log.gz 2023-11-08T19:53:54.110 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73806.log 2023-11-08T19:53:54.110 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60298.log.gz 2023-11-08T19:53:54.110 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36174.log 2023-11-08T19:53:54.110 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2023-11-08T19:53:54.111 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2023-11-08T19:53:54.111 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73806.log.gz 2023-11-08T19:53:54.111 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.36174.log: -- /var/log/ceph/ceph-client.admin.51001.log 2023-11-08T19:53:54.111 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36174.log.gz 2023-11-08T19:53:54.112 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.44329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34392.log 2023-11-08T19:53:54.112 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2023-11-08T19:53:54.112 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.51001.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57422.log 2023-11-08T19:53:54.113 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51001.log.gz 2023-11-08T19:53:54.113 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71446.log 2023-11-08T19:53:54.113 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34392.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz 2023-11-08T19:53:54.113 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42918.log 2023-11-08T19:53:54.114 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.57422.log.gz 2023-11-08T19:53:54.114 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56928.log 2023-11-08T19:53:54.114 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71446.log.gz 2023-11-08T19:53:54.114 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64314.log 2023-11-08T19:53:54.115 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42918.log.gz 2023-11-08T19:53:54.115 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-08T19:53:54.115 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56928.log.gz 2023-11-08T19:53:54.115 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2023-11-08T19:53:54.116 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64314.log.gz 2023-11-08T19:53:54.116 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47370.log 2023-11-08T19:53:54.116 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67217.log /var/log/ceph/ceph-client.admin.45144.log: 2023-11-08T19:53:54.117 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2023-11-08T19:53:54.117 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35244.log 2023-11-08T19:53:54.117 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2023-11-08T19:53:54.117 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36016.log 2023-11-08T19:53:54.118 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67217.log.gz 2023-11-08T19:53:54.118 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51345.log 2023-11-08T19:53:54.118 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35244.log.gz 2023-11-08T19:53:54.118 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75261.log 2023-11-08T19:53:54.119 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36016.log.gz 2023-11-08T19:53:54.119 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34541.log 2023-11-08T19:53:54.119 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51345.log.gz 2023-11-08T19:53:54.119 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54337.log 2023-11-08T19:53:54.120 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75261.log: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.75261.log.gz 2023-11-08T19:53:54.120 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64660.log 2023-11-08T19:53:54.120 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34541.log.gz 2023-11-08T19:53:54.121 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45966.log 2023-11-08T19:53:54.121 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54337.log.gz 2023-11-08T19:53:54.121 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35564.log 2023-11-08T19:53:54.121 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64660.log.gz 2023-11-08T19:53:54.122 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62525.log 2023-11-08T19:53:54.122 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45966.log.gz 2023-11-08T19:53:54.122 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64035.log 2023-11-08T19:53:54.122 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35564.log.gz 2023-11-08T19:53:54.123 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68446.log 2023-11-08T19:53:54.123 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62525.log.gz 2023-11-08T19:53:54.123 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73849.log 2023-11-08T19:53:54.124 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64035.log.gz 2023-11-08T19:53:54.124 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.68446.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70219.log 2023-11-08T19:53:54.124 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68446.log.gz 2023-11-08T19:53:54.124 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81359.log 2023-11-08T19:53:54.125 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73849.log.gz 2023-11-08T19:53:54.125 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72110.log 2023-11-08T19:53:54.125 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70219.log.gz 2023-11-08T19:53:54.125 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.81359.log: --verbose -- /var/log/ceph/ceph-client.admin.43122.log 2023-11-08T19:53:54.126 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81359.log.gz 2023-11-08T19:53:54.126 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65466.log 2023-11-08T19:53:54.126 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72110.log.gz 2023-11-08T19:53:54.127 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50526.log 2023-11-08T19:53:54.127 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43122.log.gz 2023-11-08T19:53:54.127 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2023-11-08T19:53:54.127 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65466.log.gz 2023-11-08T19:53:54.128 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.50526.log: --verbose -- /var/log/ceph/ceph-client.admin.30061.log 2023-11-08T19:53:54.128 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50526.log.gz 2023-11-08T19:53:54.128 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2023-11-08T19:53:54.128 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2023-11-08T19:53:54.129 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2023-11-08T19:53:54.129 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.30061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30061.log.gz 2023-11-08T19:53:54.129 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61665.log 2023-11-08T19:53:54.129 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2023-11-08T19:53:54.130 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33261.log 2023-11-08T19:53:54.130 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz 2023-11-08T19:53:54.130 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2023-11-08T19:53:54.131 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61665.log.gz 2023-11-08T19:53:54.131 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33261.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.42097.log 2023-11-08T19:53:54.131 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33261.log.gz 2023-11-08T19:53:54.131 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52824.log 2023-11-08T19:53:54.132 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2023-11-08T19:53:54.132 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53625.log 2023-11-08T19:53:54.132 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42097.log.gz 2023-11-08T19:53:54.133 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43173.log 2023-11-08T19:53:54.133 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52824.log.gz 2023-11-08T19:53:54.133 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71522.log 2023-11-08T19:53:54.133 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53625.log.gz 2023-11-08T19:53:54.134 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.43173.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66263.log 2023-11-08T19:53:54.134 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43173.log.gz 2023-11-08T19:53:54.134 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77687.log 2023-11-08T19:53:54.135 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71522.log.gz 2023-11-08T19:53:54.135 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41577.log 2023-11-08T19:53:54.135 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66263.log.gz 2023-11-08T19:53:54.135 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77687.log: /var/log/ceph/ceph-client.admin.76316.log 2023-11-08T19:53:54.136 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77687.log.gz 2023-11-08T19:53:54.136 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35202.log 2023-11-08T19:53:54.136 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41577.log.gz 2023-11-08T19:53:54.137 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43870.log 2023-11-08T19:53:54.137 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76316.log.gz 2023-11-08T19:53:54.137 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71675.log 2023-11-08T19:53:54.137 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35202.log.gz 2023-11-08T19:53:54.138 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40126.log 2023-11-08T19:53:54.138 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2023-11-08T19:53:54.138 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43870.log.gz 2023-11-08T19:53:54.138 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71675.log.gz 2023-11-08T19:53:54.139 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40126.log: /var/log/ceph/ceph-client.admin.53275.log 2023-11-08T19:53:54.139 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40126.log.gz 2023-11-08T19:53:54.139 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62977.log 2023-11-08T19:53:54.140 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2023-11-08T19:53:54.140 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53275.log.gz 2023-11-08T19:53:54.140 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2023-11-08T19:53:54.140 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42986.log 2023-11-08T19:53:54.141 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62977.log.gz 2023-11-08T19:53:54.141 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60083.log 2023-11-08T19:53:54.141 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2023-11-08T19:53:54.141 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42986.log.gz 2023-11-08T19:53:54.142 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45987.log 2023-11-08T19:53:54.142 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39803.log 2023-11-08T19:53:54.142 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60083.log.gz 2023-11-08T19:53:54.142 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.45987.log: -- /var/log/ceph/ceph-client.admin.74408.log 2023-11-08T19:53:54.143 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45987.log.gz 2023-11-08T19:53:54.143 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67389.log 2023-11-08T19:53:54.143 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39803.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39803.log.gz 2023-11-08T19:53:54.144 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41937.log 2023-11-08T19:53:54.144 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74408.log.gz 2023-11-08T19:53:54.144 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2023-11-08T19:53:54.144 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67389.log.gz 2023-11-08T19:53:54.145 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2023-11-08T19:53:54.145 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41937.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.41317.log 2023-11-08T19:53:54.145 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41937.log.gz 2023-11-08T19:53:54.145 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2023-11-08T19:53:54.146 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34778.log 2023-11-08T19:53:54.146 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2023-11-08T19:53:54.146 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35521.log 2023-11-08T19:53:54.147 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2023-11-08T19:53:54.147 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-11-08T19:53:54.147 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34778.log.gz 2023-11-08T19:53:54.147 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79872.log 2023-11-08T19:53:54.148 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35521.log.gz 2023-11-08T19:53:54.148 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2023-11-08T19:53:54.148 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-11-08T19:53:54.149 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64271.log 2023-11-08T19:53:54.149 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79872.log.gz 2023-11-08T19:53:54.149 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2023-11-08T19:53:54.149 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz 2023-11-08T19:53:54.150 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80413.log 2023-11-08T19:53:54.150 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64271.log.gz 2023-11-08T19:53:54.150 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2023-11-08T19:53:54.151 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2023-11-08T19:53:54.151 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57882.log 2023-11-08T19:53:54.151 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80413.log.gz 2023-11-08T19:53:54.151 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.43564.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76638.log 2023-11-08T19:53:54.152 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2023-11-08T19:53:54.152 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71996.log 2023-11-08T19:53:54.152 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57882.log.gz 2023-11-08T19:53:54.152 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2023-11-08T19:53:54.153 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76638.log.gz 2023-11-08T19:53:54.153 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63906.log 2023-11-08T19:53:54.153 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71996.log.gz 2023-11-08T19:53:54.154 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71658.log 2023-11-08T19:53:54.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2023-11-08T19:53:54.154 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54208.log 2023-11-08T19:53:54.154 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63906.log.gz 2023-11-08T19:53:54.155 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66808.log 2023-11-08T19:53:54.155 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71658.log.gz 2023-11-08T19:53:54.155 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35607.log 2023-11-08T19:53:54.155 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54208.log.gz 2023-11-08T19:53:54.156 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62094.log 2023-11-08T19:53:54.156 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66808.log.gz 2023-11-08T19:53:54.156 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42797.log 2023-11-08T19:53:54.157 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35607.log.gz 2023-11-08T19:53:54.157 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46811.log 2023-11-08T19:53:54.157 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62094.log.gz 2023-11-08T19:53:54.157 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65509.log 2023-11-08T19:53:54.158 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42797.log.gz 2023-11-08T19:53:54.158 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48082.log 2023-11-08T19:53:54.158 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46811.log.gz 2023-11-08T19:53:54.159 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2023-11-08T19:53:54.159 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65509.log.gz 2023-11-08T19:53:54.159 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2023-11-08T19:53:54.159 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48082.log.gz 2023-11-08T19:53:54.160 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.49239.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2023-11-08T19:53:54.160 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2023-11-08T19:53:54.160 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73913.log 2023-11-08T19:53:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2023-11-08T19:53:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54894.log 2023-11-08T19:53:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46491.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz 2023-11-08T19:53:54.161 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56799.log 2023-11-08T19:53:54.162 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73913.log.gz 2023-11-08T19:53:54.162 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2023-11-08T19:53:54.162 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54894.log.gz 2023-11-08T19:53:54.162 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.56799.log: -- /var/log/ceph/ceph-client.admin.47789.log 2023-11-08T19:53:54.163 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56799.log.gz 2023-11-08T19:53:54.163 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.41797.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64759.log 2023-11-08T19:53:54.163 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2023-11-08T19:53:54.164 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64142.log 2023-11-08T19:53:54.164 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2023-11-08T19:53:54.164 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34547.log 2023-11-08T19:53:54.164 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64759.log.gz 2023-11-08T19:53:54.165 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44550.log 2023-11-08T19:53:54.165 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64142.log.gz 2023-11-08T19:53:54.165 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2023-11-08T19:53:54.165 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34547.log.gz 2023-11-08T19:53:54.166 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74300.log 2023-11-08T19:53:54.166 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44550.log.gz 2023-11-08T19:53:54.166 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73449.log 2023-11-08T19:53:54.167 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2023-11-08T19:53:54.167 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77515.log 2023-11-08T19:53:54.167 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74300.log.gz 2023-11-08T19:53:54.167 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73449.log: /var/log/ceph/ceph-client.admin.53379.log 2023-11-08T19:53:54.168 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73449.log.gz 2023-11-08T19:53:54.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71855.log 2023-11-08T19:53:54.168 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77515.log.gz 2023-11-08T19:53:54.168 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61498.log 2023-11-08T19:53:54.169 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2023-11-08T19:53:54.169 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.71855.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62331.log 2023-11-08T19:53:54.169 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71855.log.gz 2023-11-08T19:53:54.170 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61498.log: /var/log/ceph/ceph-client.admin.50173.log 2023-11-08T19:53:54.170 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61498.log.gz 2023-11-08T19:53:54.170 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2023-11-08T19:53:54.170 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62331.log.gz 2023-11-08T19:53:54.171 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80116.log 2023-11-08T19:53:54.171 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50173.log.gz 2023-11-08T19:53:54.171 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78626.log 2023-11-08T19:53:54.171 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2023-11-08T19:53:54.172 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2023-11-08T19:53:54.172 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80116.log.gz 2023-11-08T19:53:54.172 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68911.log 2023-11-08T19:53:54.173 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78626.log.gz 2023-11-08T19:53:54.173 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39446.log 2023-11-08T19:53:54.173 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2023-11-08T19:53:54.173 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61815.log 2023-11-08T19:53:54.174 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68911.log.gz 2023-11-08T19:53:54.174 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47579.log 2023-11-08T19:53:54.174 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39446.log.gz 2023-11-08T19:53:54.175 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2023-11-08T19:53:54.175 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61815.log.gz 2023-11-08T19:53:54.175 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72332.log 2023-11-08T19:53:54.175 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47579.log.gz 2023-11-08T19:53:54.176 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2023-11-08T19:53:54.176 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2023-11-08T19:53:54.176 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45291.log 2023-11-08T19:53:54.176 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72332.log.gz 2023-11-08T19:53:54.177 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76079.log 2023-11-08T19:53:54.177 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2023-11-08T19:53:54.177 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76144.log 2023-11-08T19:53:54.178 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45291.log.gz 2023-11-08T19:53:54.178 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53538.log 2023-11-08T19:53:54.178 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76079.log.gz 2023-11-08T19:53:54.178 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76144.log: /var/log/ceph/ceph.tmp-client.admin.26322.log 2023-11-08T19:53:54.179 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76144.log.gz 2023-11-08T19:53:54.179 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44023.log 2023-11-08T19:53:54.179 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53538.log.gz 2023-11-08T19:53:54.179 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2023-11-08T19:53:54.180 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.tmp-client.admin.26322.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26322.log.gz 2023-11-08T19:53:54.180 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2023-11-08T19:53:54.180 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44023.log.gz 2023-11-08T19:53:54.181 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log: /var/log/ceph/ceph-client.admin.59933.log 2023-11-08T19:53:54.181 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2023-11-08T19:53:54.181 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37302.log 2023-11-08T19:53:54.181 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2023-11-08T19:53:54.182 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64400.log 2023-11-08T19:53:54.182 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59933.log.gz 2023-11-08T19:53:54.182 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50745.log 2023-11-08T19:53:54.183 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37302.log.gz 2023-11-08T19:53:54.183 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2023-11-08T19:53:54.183 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64400.log.gz 2023-11-08T19:53:54.183 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56304.log 2023-11-08T19:53:54.184 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50745.log.gz 2023-11-08T19:53:54.184 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2023-11-08T19:53:54.184 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2023-11-08T19:53:54.184 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39497.log 2023-11-08T19:53:54.185 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56304.log.gz 2023-11-08T19:53:54.185 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63563.log 2023-11-08T19:53:54.185 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2023-11-08T19:53:54.185 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61922.log 2023-11-08T19:53:54.186 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39497.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39497.log.gz 2023-11-08T19:53:54.186 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.63563.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70198.log 2023-11-08T19:53:54.186 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63563.log.gz 2023-11-08T19:53:54.187 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51324.log 2023-11-08T19:53:54.187 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61922.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.61922.log.gz 2023-11-08T19:53:54.187 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57186.log 2023-11-08T19:53:54.188 INFO:teuthology.orchestra.run.smithi196.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.70198.log.gz 2023-11-08T19:53:54.188 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74902.log 2023-11-08T19:53:54.188 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51324.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.51324.log.gz 2023-11-08T19:53:54.188 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57186.log.gz 2023-11-08T19:53:54.189 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67754.log 2023-11-08T19:53:54.189 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81035.log 2023-11-08T19:53:54.189 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74902.log.gz 2023-11-08T19:53:54.189 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80278.log 2023-11-08T19:53:54.190 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67754.log.gz 2023-11-08T19:53:54.190 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50402.log 2023-11-08T19:53:54.190 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81035.log.gz 2023-11-08T19:53:54.191 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2023-11-08T19:53:54.191 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80278.log.gz 2023-11-08T19:53:54.191 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68249.log 2023-11-08T19:53:54.191 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50402.log.gz 2023-11-08T19:53:54.192 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62396.log 2023-11-08T19:53:54.192 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2023-11-08T19:53:54.192 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67604.log 2023-11-08T19:53:54.192 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68249.log.gz 2023-11-08T19:53:54.193 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2023-11-08T19:53:54.193 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62396.log.gz 2023-11-08T19:53:54.193 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64860.log 2023-11-08T19:53:54.194 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67604.log.gz 2023-11-08T19:53:54.194 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64121.log 2023-11-08T19:53:54.194 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2023-11-08T19:53:54.195 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53467.log 2023-11-08T19:53:54.195 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64860.log.gz 2023-11-08T19:53:54.195 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58484.log 2023-11-08T19:53:54.196 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64121.log.gz 2023-11-08T19:53:54.196 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2023-11-08T19:53:54.196 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53467.log.gz 2023-11-08T19:53:54.196 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2023-11-08T19:53:54.197 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58484.log.gz 2023-11-08T19:53:54.197 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73720.log 2023-11-08T19:53:54.197 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2023-11-08T19:53:54.198 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57754.log 2023-11-08T19:53:54.198 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2023-11-08T19:53:54.198 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2023-11-08T19:53:54.198 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73720.log.gz 2023-11-08T19:53:54.199 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.57754.log: -- /var/log/ceph/ceph-client.admin.65970.log 2023-11-08T19:53:54.199 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57754.log.gz 2023-11-08T19:53:54.199 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2023-11-08T19:53:54.199 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2023-11-08T19:53:54.200 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60191.log 2023-11-08T19:53:54.200 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65970.log.gz 2023-11-08T19:53:54.200 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2023-11-08T19:53:54.200 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2023-11-08T19:53:54.201 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71289.log 2023-11-08T19:53:54.201 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60191.log.gz 2023-11-08T19:53:54.201 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44808.log 2023-11-08T19:53:54.202 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2023-11-08T19:53:54.202 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79467.log 2023-11-08T19:53:54.202 INFO:teuthology.orchestra.run.smithi196.stderr: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.71289.log.gz 2023-11-08T19:53:54.202 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56713.log 2023-11-08T19:53:54.203 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44808.log.gz 2023-11-08T19:53:54.203 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36443.log 2023-11-08T19:53:54.203 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79467.log.gz 2023-11-08T19:53:54.203 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46155.log 2023-11-08T19:53:54.204 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56713.log.gz 2023-11-08T19:53:54.204 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2023-11-08T19:53:54.204 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36443.log.gz 2023-11-08T19:53:54.205 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2023-11-08T19:53:54.205 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46155.log.gz 2023-11-08T19:53:54.205 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66145.log 2023-11-08T19:53:54.205 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 2023-11-08T19:53:54.206 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70777.log 2023-11-08T19:53:54.206 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2023-11-08T19:53:54.206 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2023-11-08T19:53:54.206 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66145.log.gz 2023-11-08T19:53:54.207 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69161.log 2023-11-08T19:53:54.207 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70777.log.gz 2023-11-08T19:53:54.207 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76531.log 2023-11-08T19:53:54.208 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.29936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2023-11-08T19:53:54.208 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70798.log 2023-11-08T19:53:54.208 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69161.log.gz 2023-11-08T19:53:54.208 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40721.log 2023-11-08T19:53:54.209 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76531.log.gz 2023-11-08T19:53:54.209 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2023-11-08T19:53:54.209 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70798.log.gz 2023-11-08T19:53:54.209 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60148.log 2023-11-08T19:53:54.210 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40721.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40721.log.gz 2023-11-08T19:53:54.210 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67797.log 2023-11-08T19:53:54.210 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2023-11-08T19:53:54.211 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log /var/log/ceph/ceph-client.admin.60148.log: 2023-11-08T19:53:54.211 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60148.log.gz 2023-11-08T19:53:54.211 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2023-11-08T19:53:54.211 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67797.log.gz 2023-11-08T19:53:54.212 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72037.log 2023-11-08T19:53:54.212 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41377.log: 0.0%/var/log/ceph/ceph-client.admin.34626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2023-11-08T19:53:54.212 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2023-11-08T19:53:54.212 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2023-11-08T19:53:54.213 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50984.log 2023-11-08T19:53:54.213 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72037.log.gz 2023-11-08T19:53:54.213 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72375.log 2023-11-08T19:53:54.214 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2023-11-08T19:53:54.214 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41517.log 2023-11-08T19:53:54.214 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50984.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50984.log.gz 2023-11-08T19:53:54.214 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63334.log 2023-11-08T19:53:54.215 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72375.log.gz 2023-11-08T19:53:54.215 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46746.log 2023-11-08T19:53:54.215 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41517.log.gz 2023-11-08T19:53:54.216 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63334.log: /var/log/ceph/ceph-client.admin.78383.log 2023-11-08T19:53:54.216 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63334.log.gz 2023-11-08T19:53:54.216 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78977.log 2023-11-08T19:53:54.216 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46746.log.gz 2023-11-08T19:53:54.217 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57057.log 2023-11-08T19:53:54.217 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78383.log.gz 2023-11-08T19:53:54.217 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49759.log 2023-11-08T19:53:54.217 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78977.log.gz 2023-11-08T19:53:54.218 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2023-11-08T19:53:54.218 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57057.log.gz 2023-11-08T19:53:54.218 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64950.log 2023-11-08T19:53:54.219 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49759.log.gz 2023-11-08T19:53:54.219 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54316.log 2023-11-08T19:53:54.219 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33181.log: gzip /var/log/ceph/ceph-client.admin.64950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2023-11-08T19:53:54.219 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.36235.log 2023-11-08T19:53:54.220 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64950.log.gz 2023-11-08T19:53:54.220 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51703.log 2023-11-08T19:53:54.220 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54316.log.gz 2023-11-08T19:53:54.220 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62654.log 2023-11-08T19:53:54.221 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36235.log.gz 2023-11-08T19:53:54.221 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52455.log 2023-11-08T19:53:54.221 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51703.log.gz 2023-11-08T19:53:54.222 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44618.log 2023-11-08T19:53:54.222 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62654.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71755.log 2023-11-08T19:53:54.222 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52455.log: 2023-11-08T19:53:54.222 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52455.log.gz 2023-11-08T19:53:54.223 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2023-11-08T19:53:54.223 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44618.log.gz 2023-11-08T19:53:54.223 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63375.log 2023-11-08T19:53:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71755.log.gz 2023-11-08T19:53:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49439.log 2023-11-08T19:53:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2023-11-08T19:53:54.224 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63375.log.gz 2023-11-08T19:53:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62783.log 2023-11-08T19:53:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54708.log 2023-11-08T19:53:54.225 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.49439.log.gz 2023-11-08T19:53:54.225 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79386.log 2023-11-08T19:53:54.226 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62783.log.gz 2023-11-08T19:53:54.226 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56842.log 2023-11-08T19:53:54.226 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54708.log.gz 2023-11-08T19:53:54.226 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76681.log 2023-11-08T19:53:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79386.log.gz 2023-11-08T19:53:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60720.log 2023-11-08T19:53:54.227 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56842.log.gz 2023-11-08T19:53:54.228 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80224.log 2023-11-08T19:53:54.228 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76681.log.gz 2023-11-08T19:53:54.228 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62590.log 2023-11-08T19:53:54.228 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60720.log.gz 2023-11-08T19:53:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62439.log 2023-11-08T19:53:54.229 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80224.log.gz 2023-11-08T19:53:54.229 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40024.log 2023-11-08T19:53:54.230 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62590.log.gz 2023-11-08T19:53:54.230 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80035.log 2023-11-08T19:53:54.230 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62439.log.gz 2023-11-08T19:53:54.230 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75241.log 2023-11-08T19:53:54.231 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40024.log.gz 2023-11-08T19:53:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44850.log 2023-11-08T19:53:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80035.log.gz 2023-11-08T19:53:54.231 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42777.log 2023-11-08T19:53:54.232 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75241.log.gz 2023-11-08T19:53:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2023-11-08T19:53:54.232 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44850.log.gz 2023-11-08T19:53:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78275.log 2023-11-08T19:53:54.233 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42777.log.gz 2023-11-08T19:53:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2023-11-08T19:53:54.233 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2023-11-08T19:53:54.234 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2023-11-08T19:53:54.234 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78275.log.gz 2023-11-08T19:53:54.234 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50297.log 2023-11-08T19:53:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2023-11-08T19:53:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63395.log 2023-11-08T19:53:54.235 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2023-11-08T19:53:54.235 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2023-11-08T19:53:54.236 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50297.log.gz 2023-11-08T19:53:54.236 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log /var/log/ceph/ceph-client.admin.63395.log: 2023-11-08T19:53:54.236 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63395.log.gz 2023-11-08T19:53:54.236 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76058.log 2023-11-08T19:53:54.237 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49036.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2023-11-08T19:53:54.237 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33960.log 2023-11-08T19:53:54.237 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2023-11-08T19:53:54.238 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39191.log 2023-11-08T19:53:54.238 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76058.log.gz 2023-11-08T19:53:54.238 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2023-11-08T19:53:54.238 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33960.log.gz 2023-11-08T19:53:54.239 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59804.log 2023-11-08T19:53:54.239 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39191.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39191.log.gz 2023-11-08T19:53:54.239 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61478.log 2023-11-08T19:53:54.239 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2023-11-08T19:53:54.240 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80791.log 2023-11-08T19:53:54.240 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59804.log.gz 2023-11-08T19:53:54.240 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38269.log 2023-11-08T19:53:54.241 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61478.log.gz 2023-11-08T19:53:54.241 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2023-11-08T19:53:54.241 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80791.log.gz 2023-11-08T19:53:54.241 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77257.log 2023-11-08T19:53:54.242 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38269.log.gz 2023-11-08T19:53:54.242 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.37216.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55605.log 2023-11-08T19:53:54.242 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2023-11-08T19:53:54.242 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64907.log 2023-11-08T19:53:54.246 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77257.log.gz 2023-11-08T19:53:54.246 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40092.log 2023-11-08T19:53:54.247 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55605.log.gz 2023-11-08T19:53:54.247 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67905.log 2023-11-08T19:53:54.247 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64907.log.gz 2023-11-08T19:53:54.247 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40092.log: /var/log/ceph/ceph-client.admin.46449.log 2023-11-08T19:53:54.248 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40092.log.gz 2023-11-08T19:53:54.248 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77855.log 2023-11-08T19:53:54.248 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67905.log.gz 2023-11-08T19:53:54.249 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52197.log 2023-11-08T19:53:54.249 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2023-11-08T19:53:54.249 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56583.log 2023-11-08T19:53:54.249 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77855.log: 59.0% -- replaced with /var/log/ceph/ceph-client.admin.77855.log.gz 2023-11-08T19:53:54.250 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72504.log 2023-11-08T19:53:54.250 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52197.log.gz 2023-11-08T19:53:54.250 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2023-11-08T19:53:54.250 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56583.log.gz 2023-11-08T19:53:54.251 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2023-11-08T19:53:54.251 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72504.log.gz 2023-11-08T19:53:54.251 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66626.log 2023-11-08T19:53:54.252 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34465.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2023-11-08T19:53:54.252 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gzgzip 2023-11-08T19:53:54.252 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2023-11-08T19:53:54.252 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78142.log 2023-11-08T19:53:54.253 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66626.log.gz 2023-11-08T19:53:54.253 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42952.log 2023-11-08T19:53:54.253 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2023-11-08T19:53:54.253 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72228.log 2023-11-08T19:53:54.254 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78142.log.gz 2023-11-08T19:53:54.254 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41917.log 2023-11-08T19:53:54.254 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42952.log.gz 2023-11-08T19:53:54.254 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70140.log 2023-11-08T19:53:54.255 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72228.log.gz 2023-11-08T19:53:54.255 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2023-11-08T19:53:54.255 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41917.log.gz 2023-11-08T19:53:54.256 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54831.log 2023-11-08T19:53:54.256 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70140.log.gz 2023-11-08T19:53:54.256 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2023-11-08T19:53:54.256 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2023-11-08T19:53:54.257 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69531.log 2023-11-08T19:53:54.257 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54831.log.gz 2023-11-08T19:53:54.257 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69864.log 2023-11-08T19:53:54.257 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2023-11-08T19:53:54.258 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51831.log 2023-11-08T19:53:54.258 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69531.log.gz 2023-11-08T19:53:54.258 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61601.log 2023-11-08T19:53:54.259 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69864.log.gz 2023-11-08T19:53:54.259 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64228.log 2023-11-08T19:53:54.259 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51831.log.gz 2023-11-08T19:53:54.259 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47348.log 2023-11-08T19:53:54.260 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61601.log.gz 2023-11-08T19:53:54.260 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55259.log 2023-11-08T19:53:54.260 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64228.log.gz 2023-11-08T19:53:54.260 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47692.log 2023-11-08T19:53:54.261 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47348.log.gz 2023-11-08T19:53:54.261 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2023-11-08T19:53:54.261 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55259.log.gz 2023-11-08T19:53:54.261 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53659.log 2023-11-08T19:53:54.262 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47692.log.gz 2023-11-08T19:53:54.262 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47911.log 2023-11-08T19:53:54.262 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2023-11-08T19:53:54.263 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.53659.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79710.log 2023-11-08T19:53:54.263 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53659.log.gz 2023-11-08T19:53:54.263 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51042.log 2023-11-08T19:53:54.263 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47911.log.gz 2023-11-08T19:53:54.264 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73892.log 2023-11-08T19:53:54.264 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79710.log.gz 2023-11-08T19:53:54.264 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45186.log 2023-11-08T19:53:54.264 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51042.log.gz 2023-11-08T19:53:54.265 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2023-11-08T19:53:54.265 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73892.log.gz 2023-11-08T19:53:54.265 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36315.log 2023-11-08T19:53:54.266 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45186.log.gz 2023-11-08T19:53:54.266 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2023-11-08T19:53:54.266 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2023-11-08T19:53:54.267 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37474.log 2023-11-08T19:53:54.267 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36315.log.gz 2023-11-08T19:53:54.267 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68560.log 2023-11-08T19:53:54.267 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2023-11-08T19:53:54.268 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75468.log 2023-11-08T19:53:54.268 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37474.log.gz 2023-11-08T19:53:54.268 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34132.log 2023-11-08T19:53:54.269 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68560.log.gz 2023-11-08T19:53:54.269 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66105.log 2023-11-08T19:53:54.269 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75468.log.gz 2023-11-08T19:53:54.269 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80981.log 2023-11-08T19:53:54.270 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34132.log.gz 2023-11-08T19:53:54.270 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2023-11-08T19:53:54.270 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66105.log.gz 2023-11-08T19:53:54.270 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2023-11-08T19:53:54.271 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80981.log.gz 2023-11-08T19:53:54.271 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz--verbose 2023-11-08T19:53:54.271 INFO:teuthology.orchestra.run.smithi196.stderr:-- /var/log/ceph/ceph-client.admin.57165.log 2023-11-08T19:53:54.272 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34892.log 2023-11-08T19:53:54.272 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2023-11-08T19:53:54.272 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79737.log 2023-11-08T19:53:54.272 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57165.log.gz 2023-11-08T19:53:54.273 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73741.log 2023-11-08T19:53:54.273 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34892.log.gz 2023-11-08T19:53:54.273 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79737.log: /var/log/ceph/ceph-client.admin.79683.log 2023-11-08T19:53:54.273 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79737.log.gz 2023-11-08T19:53:54.274 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79575.log 2023-11-08T19:53:54.274 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73741.log.gz 2023-11-08T19:53:54.274 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51362.log 2023-11-08T19:53:54.274 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79683.log.gz 2023-11-08T19:53:54.275 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2023-11-08T19:53:54.275 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79575.log.gz 2023-11-08T19:53:54.275 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52412.log 2023-11-08T19:53:54.276 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51362.log: 31.1% -- replaced with /var/log/ceph/ceph-client.admin.51362.log.gz 2023-11-08T19:53:54.276 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2023-11-08T19:53:54.276 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40687.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2023-11-08T19:53:54.276 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61315.log 2023-11-08T19:53:54.277 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52412.log.gz 2023-11-08T19:53:54.277 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56692.log 2023-11-08T19:53:54.277 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2023-11-08T19:53:54.277 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41457.log 2023-11-08T19:53:54.278 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61315.log.gz 2023-11-08T19:53:54.278 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47112.log 2023-11-08T19:53:54.278 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56692.log.gz 2023-11-08T19:53:54.278 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60798.log 2023-11-08T19:53:54.279 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41457.log.gz 2023-11-08T19:53:54.279 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57990.log 2023-11-08T19:53:54.279 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47112.log.gz 2023-11-08T19:53:54.279 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36075.log 2023-11-08T19:53:54.280 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60798.log.gz 2023-11-08T19:53:54.280 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63127.log 2023-11-08T19:53:54.280 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57990.log.gz 2023-11-08T19:53:54.281 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53502.log 2023-11-08T19:53:54.281 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36075.log.gz 2023-11-08T19:53:54.281 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66873.log 2023-11-08T19:53:54.281 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63127.log.gz 2023-11-08T19:53:54.282 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2023-11-08T19:53:54.282 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53502.log.gz 2023-11-08T19:53:54.282 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2023-11-08T19:53:54.282 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66873.log.gz 2023-11-08T19:53:54.283 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39003.log 2023-11-08T19:53:54.283 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2023-11-08T19:53:54.283 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41997.log 2023-11-08T19:53:54.283 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2023-11-08T19:53:54.284 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41777.log 2023-11-08T19:53:54.284 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39003.log.gz 2023-11-08T19:53:54.284 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41997.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41997.log.gz-5 2023-11-08T19:53:54.285 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.50317.log 2023-11-08T19:53:54.285 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67776.log 2023-11-08T19:53:54.285 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41777.log.gz 2023-11-08T19:53:54.285 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77558.log 2023-11-08T19:53:54.286 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50317.log.gz 2023-11-08T19:53:54.286 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2023-11-08T19:53:54.286 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67776.log.gz 2023-11-08T19:53:54.286 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35328.log 2023-11-08T19:53:54.287 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77558.log.gz 2023-11-08T19:53:54.287 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52498.log 2023-11-08T19:53:54.287 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2023-11-08T19:53:54.287 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47477.log 2023-11-08T19:53:54.288 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35328.log.gz 2023-11-08T19:53:54.288 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60427.log 2023-11-08T19:53:54.288 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52498.log.gz 2023-11-08T19:53:54.289 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2023-11-08T19:53:54.289 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47477.log.gz 2023-11-08T19:53:54.289 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52025.log 2023-11-08T19:53:54.289 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60427.log.gz 2023-11-08T19:53:54.290 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42969.log 2023-11-08T19:53:54.290 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2023-11-08T19:53:54.290 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78950.log 2023-11-08T19:53:54.290 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52025.log.gz 2023-11-08T19:53:54.291 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33235.log 2023-11-08T19:53:54.291 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42969.log.gz 2023-11-08T19:53:54.291 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37818.log 2023-11-08T19:53:54.292 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78950.log.gz 2023-11-08T19:53:54.292 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72633.log 2023-11-08T19:53:54.292 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33235.log.gz 2023-11-08T19:53:54.292 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55285.log 2023-11-08T19:53:54.293 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37818.log.gz 2023-11-08T19:53:54.293 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2023-11-08T19:53:54.293 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72633.log.gz 2023-11-08T19:53:54.294 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2023-11-08T19:53:54.294 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55285.log.gz 2023-11-08T19:53:54.294 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55434.log 2023-11-08T19:53:54.294 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2023-11-08T19:53:54.295 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36851.log 2023-11-08T19:53:54.295 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gz 2023-11-08T19:53:54.295 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70623.log 2023-11-08T19:53:54.296 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55434.log.gz 2023-11-08T19:53:54.296 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64600.log 2023-11-08T19:53:54.296 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2023-11-08T19:53:54.296 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2023-11-08T19:53:54.297 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70623.log.gz 2023-11-08T19:53:54.297 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2023-11-08T19:53:54.297 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64600.log.gz 2023-11-08T19:53:54.297 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2023-11-08T19:53:54.298 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2023-11-08T19:53:54.298 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61707.log 2023-11-08T19:53:54.298 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2023-11-08T19:53:54.299 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63992.log 2023-11-08T19:53:54.299 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2023-11-08T19:53:54.299 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57503.log 2023-11-08T19:53:54.299 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61707.log.gz 2023-11-08T19:53:54.300 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40381.log 2023-11-08T19:53:54.300 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63992.log.gz 2023-11-08T19:53:54.300 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2023-11-08T19:53:54.301 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57503.log.gz 2023-11-08T19:53:54.301 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75096.log 2023-11-08T19:53:54.301 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40381.log.gz 2023-11-08T19:53:54.301 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36379.log 2023-11-08T19:53:54.302 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2023-11-08T19:53:54.302 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65790.log 2023-11-08T19:53:54.302 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75096.log.gz 2023-11-08T19:53:54.302 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65401.log 2023-11-08T19:53:54.303 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36379.log.gz 2023-11-08T19:53:54.303 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39837.log 2023-11-08T19:53:54.303 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65790.log.gz 2023-11-08T19:53:54.304 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2023-11-08T19:53:54.304 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65401.log.gz 2023-11-08T19:53:54.304 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35042.log 2023-11-08T19:53:54.304 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39837.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39837.log.gz 2023-11-08T19:53:54.305 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.65251.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42317.log 2023-11-08T19:53:54.305 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2023-11-08T19:53:54.305 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34218.log 2023-11-08T19:53:54.305 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35042.log.gz 2023-11-08T19:53:54.306 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56756.log 2023-11-08T19:53:54.306 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42317.log.gz 2023-11-08T19:53:54.306 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34409.log 2023-11-08T19:53:54.307 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34218.log.gz 2023-11-08T19:53:54.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.56756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74752.log 2023-11-08T19:53:54.307 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56756.log.gz 2023-11-08T19:53:54.307 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43649.log 2023-11-08T19:53:54.308 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34409.log.gz 2023-11-08T19:53:54.308 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2023-11-08T19:53:54.308 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74752.log.gz 2023-11-08T19:53:54.308 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2023-11-08T19:53:54.309 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43649.log.gz 2023-11-08T19:53:54.309 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37582.log 2023-11-08T19:53:54.309 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2023-11-08T19:53:54.309 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75571.log 2023-11-08T19:53:54.310 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2023-11-08T19:53:54.310 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52540.log 2023-11-08T19:53:54.310 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37582.log.gz 2023-11-08T19:53:54.311 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2023-11-08T19:53:54.311 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75571.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.75571.log.gz 2023-11-08T19:53:54.311 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.52540.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66320.log 2023-11-08T19:53:54.311 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52540.log.gz 2023-11-08T19:53:54.312 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73571.log 2023-11-08T19:53:54.312 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46134.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2023-11-08T19:53:54.312 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49926.log 2023-11-08T19:53:54.312 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66320.log.gz 2023-11-08T19:53:54.313 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 2023-11-08T19:53:54.313 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73571.log.gz 2023-11-08T19:53:54.313 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34720.log 2023-11-08T19:53:54.313 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49926.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49926.log.gz/var/log/ceph/ceph-client.admin.81224.log 2023-11-08T19:53:54.314 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.314 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52476.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.56068.log -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2023-11-08T19:53:54.314 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.315 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34720.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34720.log.gz 2023-11-08T19:53:54.315 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57567.log 2023-11-08T19:53:54.315 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81224.log.gz 2023-11-08T19:53:54.315 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33287.log 2023-11-08T19:53:54.316 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56068.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.56068.log.gz 2023-11-08T19:53:54.316 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68753.log 2023-11-08T19:53:54.316 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57567.log.gz 2023-11-08T19:53:54.316 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49497.log 2023-11-08T19:53:54.317 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33287.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72740.log 2023-11-08T19:53:54.317 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33287.log.gz 2023-11-08T19:53:54.317 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68753.log.gz 2023-11-08T19:53:54.318 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75224.log 2023-11-08T19:53:54.318 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49497.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.49497.log.gz 2023-11-08T19:53:54.318 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71618.log 2023-11-08T19:53:54.318 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72740.log.gz 2023-11-08T19:53:54.319 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32749.log 2023-11-08T19:53:54.319 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75224.log.gz 2023-11-08T19:53:54.319 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74365.log 2023-11-08T19:53:54.319 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71618.log.gz 2023-11-08T19:53:54.320 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68227.log 2023-11-08T19:53:54.320 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32749.log.gz 2023-11-08T19:53:54.320 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36894.log 2023-11-08T19:53:54.321 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74365.log.gz 2023-11-08T19:53:54.321 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68227.log.gz 2023-11-08T19:53:54.321 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54273.log 2023-11-08T19:53:54.321 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70315.log 2023-11-08T19:53:54.322 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36894.log.gz 2023-11-08T19:53:54.322 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63020.log 2023-11-08T19:53:54.322 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54273.log.gz 2023-11-08T19:53:54.322 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54294.log 2023-11-08T19:53:54.323 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70315.log.gz 2023-11-08T19:53:54.323 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63020.log.gz 2023-11-08T19:53:54.323 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59997.log 2023-11-08T19:53:54.324 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54294.log: /var/log/ceph/ceph-client.admin.69646.log 2023-11-08T19:53:54.324 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54294.log.gz 2023-11-08T19:53:54.324 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40619.log 2023-11-08T19:53:54.324 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59997.log.gz 2023-11-08T19:53:54.325 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39310.log 2023-11-08T19:53:54.325 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69646.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71384.log 2023-11-08T19:53:54.325 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69646.log.gz/var/log/ceph/ceph-client.admin.40619.log: 2023-11-08T19:53:54.325 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40619.log.gz 2023-11-08T19:53:54.326 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76402.log 2023-11-08T19:53:54.326 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39310.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39310.log.gz 2023-11-08T19:53:54.326 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54187.log 2023-11-08T19:53:54.327 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71384.log.gz 2023-11-08T19:53:54.327 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.76402.log: -- /var/log/ceph/ceph-client.admin.71638.log 2023-11-08T19:53:54.327 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76402.log.gz 2023-11-08T19:53:54.327 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78815.log 2023-11-08T19:53:54.328 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54187.log.gz 2023-11-08T19:53:54.328 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61107.log 2023-11-08T19:53:54.328 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71638.log.gz 2023-11-08T19:53:54.328 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67174.log 2023-11-08T19:53:54.329 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78815.log.gz 2023-11-08T19:53:54.329 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40364.log 2023-11-08T19:53:54.329 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61107.log.gz 2023-11-08T19:53:54.330 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34543.log 2023-11-08T19:53:54.330 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67174.log.gz 2023-11-08T19:53:54.330 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58033.log 2023-11-08T19:53:54.330 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40364.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40364.log.gz 2023-11-08T19:53:54.331 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34543.log.gz 2023-11-08T19:53:54.331 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2023-11-08T19:53:54.331 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71209.log 2023-11-08T19:53:54.332 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58033.log.gz 2023-11-08T19:53:54.332 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.53774.log: -- /var/log/ceph/ceph-client.admin.36486.log 2023-11-08T19:53:54.332 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2023-11-08T19:53:54.332 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71956.log 2023-11-08T19:53:54.333 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71209.log.gz 2023-11-08T19:53:54.333 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40670.log 2023-11-08T19:53:54.333 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2023-11-08T19:53:54.333 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72092.log 2023-11-08T19:53:54.334 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71956.log.gz 2023-11-08T19:53:54.334 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64478.log 2023-11-08T19:53:54.334 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40670.log.gz 2023-11-08T19:53:54.334 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74623.log 2023-11-08T19:53:54.335 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72092.log.gz 2023-11-08T19:53:54.335 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52111.log 2023-11-08T19:53:54.335 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64478.log.gz 2023-11-08T19:53:54.336 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2023-11-08T19:53:54.336 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74623.log.gz 2023-11-08T19:53:54.336 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52111.log.gz 2023-11-08T19:53:54.336 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2023-11-08T19:53:54.337 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50823.log 2023-11-08T19:53:54.337 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2023-11-08T19:53:54.337 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76999.log 2023-11-08T19:53:54.337 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2023-11-08T19:53:54.338 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2023-11-08T19:53:54.338 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50823.log.gz 2023-11-08T19:53:54.338 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75160.log 2023-11-08T19:53:54.339 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76999.log.gz 2023-11-08T19:53:54.339 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53795.log 2023-11-08T19:53:54.339 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2023-11-08T19:53:54.339 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78761.log 2023-11-08T19:53:54.340 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75160.log.gz 2023-11-08T19:53:54.340 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2023-11-08T19:53:54.340 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53795.log.gz 2023-11-08T19:53:54.340 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74193.log 2023-11-08T19:53:54.341 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78761.log.gz 2023-11-08T19:53:54.341 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41717.log 2023-11-08T19:53:54.341 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2023-11-08T19:53:54.342 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75428.log 2023-11-08T19:53:54.342 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74193.log.gz 2023-11-08T19:53:54.342 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43360.log 2023-11-08T19:53:54.342 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41717.log.gz 2023-11-08T19:53:54.343 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74064.log 2023-11-08T19:53:54.343 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75428.log.gz 2023-11-08T19:53:54.343 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78572.log 2023-11-08T19:53:54.343 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43360.log.gz 2023-11-08T19:53:54.344 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80575.log 2023-11-08T19:53:54.344 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74064.log.gz 2023-11-08T19:53:54.344 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35285.log 2023-11-08T19:53:54.345 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78572.log.gz 2023-11-08T19:53:54.345 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70741.log 2023-11-08T19:53:54.345 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80575.log.gz 2023-11-08T19:53:54.345 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46302.log 2023-11-08T19:53:54.346 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35285.log.gz 2023-11-08T19:53:54.346 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68600.log 2023-11-08T19:53:54.346 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70741.log.gz 2023-11-08T19:53:54.346 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78034.log 2023-11-08T19:53:54.347 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2023-11-08T19:53:54.347 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57036.log 2023-11-08T19:53:54.347 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68600.log.gz 2023-11-08T19:53:54.348 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2023-11-08T19:53:54.348 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78034.log.gz 2023-11-08T19:53:54.348 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71935.log 2023-11-08T19:53:54.348 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57036.log.gz 2023-11-08T19:53:54.349 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63063.log 2023-11-08T19:53:54.349 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2023-11-08T19:53:54.349 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37410.log 2023-11-08T19:53:54.349 INFO:teuthology.orchestra.run.smithi196.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.71935.log.gz 2023-11-08T19:53:54.350 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67195.log 2023-11-08T19:53:54.350 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63063.log.gz 2023-11-08T19:53:54.350 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67711.log 2023-11-08T19:53:54.351 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37410.log.gz 2023-11-08T19:53:54.351 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55454.log 2023-11-08T19:53:54.351 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67195.log.gz 2023-11-08T19:53:54.351 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67711.log: /var/log/ceph/ceph-client.admin.66563.log 2023-11-08T19:53:54.352 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67711.log.gz 2023-11-08T19:53:54.352 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66421.log 2023-11-08T19:53:54.352 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55454.log.gz 2023-11-08T19:53:54.352 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60384.log 2023-11-08T19:53:54.353 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66563.log.gz 2023-11-08T19:53:54.353 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77836.log 2023-11-08T19:53:54.353 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66421.log.gz 2023-11-08T19:53:54.354 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69352.log 2023-11-08T19:53:54.354 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60384.log.gz 2023-11-08T19:53:54.354 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2023-11-08T19:53:54.354 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77836.log.gz 2023-11-08T19:53:54.355 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71330.log 2023-11-08T19:53:54.355 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69352.log.gz 2023-11-08T19:53:54.355 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61559.log 2023-11-08T19:53:54.355 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2023-11-08T19:53:54.356 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38401.log 2023-11-08T19:53:54.356 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71330.log.gz 2023-11-08T19:53:54.356 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2023-11-08T19:53:54.357 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61559.log.gz 2023-11-08T19:53:54.357 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38938.log 2023-11-08T19:53:54.357 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38401.log.gz 2023-11-08T19:53:54.357 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80710.log 2023-11-08T19:53:54.358 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2023-11-08T19:53:54.358 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77278.log 2023-11-08T19:53:54.358 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38938.log.gz 2023-11-08T19:53:54.359 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52218.log 2023-11-08T19:53:54.359 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80710.log.gz 2023-11-08T19:53:54.359 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72310.log 2023-11-08T19:53:54.359 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77278.log.gz 2023-11-08T19:53:54.360 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74515.log 2023-11-08T19:53:54.360 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52218.log.gz 2023-11-08T19:53:54.360 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60819.log 2023-11-08T19:53:54.361 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72310.log.gz 2023-11-08T19:53:54.361 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.74515.log: --verbose -- /var/log/ceph/ceph-client.admin.66049.log 2023-11-08T19:53:54.361 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74515.log.gz 2023-11-08T19:53:54.361 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2023-11-08T19:53:54.362 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60819.log.gz 2023-11-08T19:53:54.362 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58506.log 2023-11-08T19:53:54.362 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66049.log.gz 2023-11-08T19:53:54.362 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2023-11-08T19:53:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57401.log 2023-11-08T19:53:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2023-11-08T19:53:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58506.log.gz 2023-11-08T19:53:54.363 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58291.log 2023-11-08T19:53:54.364 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57401.log.gz 2023-11-08T19:53:54.364 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58463.log 2023-11-08T19:53:54.364 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2023-11-08T19:53:54.365 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68717.log 2023-11-08T19:53:54.365 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58291.log.gz 2023-11-08T19:53:54.365 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44637.log 2023-11-08T19:53:54.365 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58463.log.gz 2023-11-08T19:53:54.366 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65948.log 2023-11-08T19:53:54.366 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68717.log.gz 2023-11-08T19:53:54.366 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77063.log 2023-11-08T19:53:54.366 INFO:teuthology.orchestra.run.smithi196.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.44637.log.gz 2023-11-08T19:53:54.367 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65948.log: /var/log/ceph/ceph-client.admin.61836.log 2023-11-08T19:53:54.367 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65948.log.gz 2023-11-08T19:53:54.367 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74687.log 2023-11-08T19:53:54.367 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77063.log.gz 2023-11-08T19:53:54.368 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77601.log 2023-11-08T19:53:54.368 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61836.log.gz 2023-11-08T19:53:54.368 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65811.log 2023-11-08T19:53:54.369 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74687.log.gz 2023-11-08T19:53:54.369 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62912.log 2023-11-08T19:53:54.369 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77601.log.gz 2023-11-08T19:53:54.369 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55370.log 2023-11-08T19:53:54.370 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65811.log.gz 2023-11-08T19:53:54.370 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62504.log 2023-11-08T19:53:54.370 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62912.log.gz 2023-11-08T19:53:54.371 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58441.log 2023-11-08T19:53:54.371 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55370.log.gz 2023-11-08T19:53:54.371 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80818.log 2023-11-08T19:53:54.371 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62504.log.gz 2023-11-08T19:53:54.372 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58441.log: /var/log/ceph/ceph-client.admin.49294.log 2023-11-08T19:53:54.372 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58441.log.gz 2023-11-08T19:53:54.372 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70041.log 2023-11-08T19:53:54.372 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80818.log.gz 2023-11-08T19:53:54.373 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2023-11-08T19:53:54.373 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49294.log.gz 2023-11-08T19:53:54.373 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74236.log 2023-11-08T19:53:54.374 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70041.log.gz 2023-11-08T19:53:54.374 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61251.log 2023-11-08T19:53:54.374 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2023-11-08T19:53:54.374 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48297.log 2023-11-08T19:53:54.375 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74236.log.gz 2023-11-08T19:53:54.375 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68184.log 2023-11-08T19:53:54.375 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61251.log.gz 2023-11-08T19:53:54.375 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79954.log 2023-11-08T19:53:54.376 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48297.log.gz 2023-11-08T19:53:54.376 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78518.log 2023-11-08T19:53:54.376 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68184.log.gz 2023-11-08T19:53:54.377 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75697.log 2023-11-08T19:53:54.377 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79954.log.gz 2023-11-08T19:53:54.377 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2023-11-08T19:53:54.377 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78518.log.gz 2023-11-08T19:53:54.378 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47713.log 2023-11-08T19:53:54.378 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75697.log.gz 2023-11-08T19:53:54.378 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2023-11-08T19:53:54.378 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2023-11-08T19:53:54.379 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48533.log 2023-11-08T19:53:54.379 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47713.log.gz 2023-11-08T19:53:54.379 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74451.log 2023-11-08T19:53:54.380 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2023-11-08T19:53:54.380 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61644.log 2023-11-08T19:53:54.380 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48533.log.gz 2023-11-08T19:53:54.380 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51874.log 2023-11-08T19:53:54.381 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74451.log.gz 2023-11-08T19:53:54.381 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2023-11-08T19:53:54.381 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61644.log.gz 2023-11-08T19:53:54.381 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63041.log 2023-11-08T19:53:54.382 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51874.log.gz 2023-11-08T19:53:54.382 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2023-11-08T19:53:54.382 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2023-11-08T19:53:54.383 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78168.log 2023-11-08T19:53:54.383 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63041.log.gz 2023-11-08T19:53:54.383 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70895.log 2023-11-08T19:53:54.383 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2023-11-08T19:53:54.384 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40466.log 2023-11-08T19:53:54.384 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78168.log.gz 2023-11-08T19:53:54.384 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53993.log 2023-11-08T19:53:54.384 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70895.log.gz 2023-11-08T19:53:54.385 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61858.log 2023-11-08T19:53:54.385 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40466.log.gz 2023-11-08T19:53:54.385 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71405.log 2023-11-08T19:53:54.386 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53993.log.gz 2023-11-08T19:53:54.386 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2023-11-08T19:53:54.386 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61858.log.gz 2023-11-08T19:53:54.386 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65850.log 2023-11-08T19:53:54.387 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71405.log.gz 2023-11-08T19:53:54.387 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30033.log 2023-11-08T19:53:54.387 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50803.log: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2023-11-08T19:53:54.388 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2023-11-08T19:53:54.388 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65850.log.gz 2023-11-08T19:53:54.388 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.30033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57229.log 2023-11-08T19:53:54.388 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30033.log.gz 2023-11-08T19:53:54.389 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62611.log 2023-11-08T19:53:54.389 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2023-11-08T19:53:54.389 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2023-11-08T19:53:54.389 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57229.log.gz 2023-11-08T19:53:54.390 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2023-11-08T19:53:54.390 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62611.log: 0.0%/var/log/ceph/ceph-client.admin.41237.log: -- replaced with /var/log/ceph/ceph-client.admin.62611.log.gz 2023-11-08T19:53:54.390 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66087.log 2023-11-08T19:53:54.390 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2023-11-08T19:53:54.391 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48787.log 2023-11-08T19:53:54.391 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2023-11-08T19:53:54.391 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47198.log 2023-11-08T19:53:54.391 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66087.log.gz 2023-11-08T19:53:54.392 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69987.log 2023-11-08T19:53:54.392 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48787.log.gz 2023-11-08T19:53:54.392 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.47198.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2023-11-08T19:53:54.393 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47198.log.gz 2023-11-08T19:53:54.393 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46512.log 2023-11-08T19:53:54.393 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69987.log.gz 2023-11-08T19:53:54.394 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75530.log 2023-11-08T19:53:54.394 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2023-11-08T19:53:54.394 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38723.log 2023-11-08T19:53:54.394 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46512.log.gz 2023-11-08T19:53:54.395 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71089.log 2023-11-08T19:53:54.395 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75530.log.gz 2023-11-08T19:53:54.395 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2023-11-08T19:53:54.396 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38723.log.gz 2023-11-08T19:53:54.396 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56411.log 2023-11-08T19:53:54.396 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71089.log.gz 2023-11-08T19:53:54.396 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37775.log 2023-11-08T19:53:54.397 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2023-11-08T19:53:54.397 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61086.log 2023-11-08T19:53:54.397 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56411.log.gz 2023-11-08T19:53:54.397 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64336.log 2023-11-08T19:53:54.398 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37775.log.gz 2023-11-08T19:53:54.398 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52261.log 2023-11-08T19:53:54.398 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61086.log.gz 2023-11-08T19:53:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68505.log 2023-11-08T19:53:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64336.log.gz 2023-11-08T19:53:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44745.log 2023-11-08T19:53:54.399 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52261.log.gz 2023-11-08T19:53:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2023-11-08T19:53:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68505.log.gz 2023-11-08T19:53:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2023-11-08T19:53:54.400 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44745.log.gz 2023-11-08T19:53:54.401 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60757.log 2023-11-08T19:53:54.401 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2023-11-08T19:53:54.401 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2023-11-08T19:53:54.402 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2023-11-08T19:53:54.402 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39242.log 2023-11-08T19:53:54.402 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60757.log.gz 2023-11-08T19:53:54.402 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78193.log 2023-11-08T19:53:54.403 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2023-11-08T19:53:54.403 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2023-11-08T19:53:54.403 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39242.log.gz 2023-11-08T19:53:54.404 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.78193.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72676.log 2023-11-08T19:53:54.404 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78193.log.gz 2023-11-08T19:53:54.404 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36273.log 2023-11-08T19:53:54.404 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 2023-11-08T19:53:54.405 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39582.log 2023-11-08T19:53:54.405 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72676.log.gz 2023-11-08T19:53:54.405 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37453.log 2023-11-08T19:53:54.406 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36273.log.gz 2023-11-08T19:53:54.406 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53060.log 2023-11-08T19:53:54.406 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39582.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39582.log.gz 2023-11-08T19:53:54.406 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33723.log 2023-11-08T19:53:54.407 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37453.log.gz 2023-11-08T19:53:54.407 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48912.log 2023-11-08T19:53:54.407 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53060.log.gz 2023-11-08T19:53:54.407 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38960.log 2023-11-08T19:53:54.408 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33723.log.gz 2023-11-08T19:53:54.408 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46940.log 2023-11-08T19:53:54.408 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48912.log.gz 2023-11-08T19:53:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77838.log 2023-11-08T19:53:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38960.log.gz 2023-11-08T19:53:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59847.log 2023-11-08T19:53:54.409 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46940.log.gz 2023-11-08T19:53:54.410 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2023-11-08T19:53:54.410 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77838.log.gz 2023-11-08T19:53:54.410 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41097.log 2023-11-08T19:53:54.411 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59847.log.gz 2023-11-08T19:53:54.411 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76789.log 2023-11-08T19:53:54.411 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39718.log: 1.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53556.log 2023-11-08T19:53:54.411 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz/var/log/ceph/ceph-client.admin.41097.log: 2023-11-08T19:53:54.412 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41097.log.gz 2023-11-08T19:53:54.412 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56133.log 2023-11-08T19:53:54.412 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76789.log.gz 2023-11-08T19:53:54.412 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55767.log 2023-11-08T19:53:54.413 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53556.log.gz 2023-11-08T19:53:54.413 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2023-11-08T19:53:54.413 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56133.log.gz 2023-11-08T19:53:54.414 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63949.log 2023-11-08T19:53:54.414 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55767.log.gz 2023-11-08T19:53:54.414 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60497.log 2023-11-08T19:53:54.414 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40840.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2023-11-08T19:53:54.415 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61171.log 2023-11-08T19:53:54.415 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63949.log.gz 2023-11-08T19:53:54.415 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2023-11-08T19:53:54.415 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60497.log.gz 2023-11-08T19:53:54.416 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60921.log 2023-11-08T19:53:54.416 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61171.log.gz 2023-11-08T19:53:54.416 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2023-11-08T19:53:54.417 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2023-11-08T19:53:54.417 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66242.log 2023-11-08T19:53:54.417 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60921.log.gz 2023-11-08T19:53:54.417 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33047.log 2023-11-08T19:53:54.418 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2023-11-08T19:53:54.418 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2023-11-08T19:53:54.418 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2023-11-08T19:53:54.419 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66242.log.gz 2023-11-08T19:53:54.419 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57587.log 2023-11-08T19:53:54.419 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33047.log.gz 2023-11-08T19:53:54.419 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40483.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2023-11-08T19:53:54.420 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2023-11-08T19:53:54.420 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz 2023-11-08T19:53:54.420 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2023-11-08T19:53:54.421 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57587.log.gz 2023-11-08T19:53:54.421 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71189.log 2023-11-08T19:53:54.421 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2023-11-08T19:53:54.421 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2023-11-08T19:53:54.422 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2023-11-08T19:53:54.422 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2023-11-08T19:53:54.422 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71189.log.gz 2023-11-08T19:53:54.423 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35182.log 2023-11-08T19:53:54.423 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47850.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2023-11-08T19:53:54.423 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2023-11-08T19:53:54.423 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2023-11-08T19:53:54.424 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34261.log 2023-11-08T19:53:54.424 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35182.log.gz 2023-11-08T19:53:54.424 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78302.log 2023-11-08T19:53:54.425 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2023-11-08T19:53:54.425 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57818.log 2023-11-08T19:53:54.425 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2023-11-08T19:53:54.425 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50864.log 2023-11-08T19:53:54.426 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78302.log.gz 2023-11-08T19:53:54.426 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57775.log 2023-11-08T19:53:54.426 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57818.log.gz 2023-11-08T19:53:54.426 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40957.log 2023-11-08T19:53:54.427 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50864.log.gz 2023-11-08T19:53:54.427 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.57775.log: -- /var/log/ceph/ceph-client.admin.72439.log 2023-11-08T19:53:54.427 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57775.log.gz 2023-11-08T19:53:54.427 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-08T19:53:54.428 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40957.log.gz 2023-11-08T19:53:54.428 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60019.log 2023-11-08T19:53:54.428 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72439.log.gz 2023-11-08T19:53:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2023-11-08T19:53:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77343.log 2023-11-08T19:53:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60019.log.gz 2023-11-08T19:53:54.429 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log: /var/log/ceph/ceph-client.admin.68270.log 2023-11-08T19:53:54.430 INFO:teuthology.orchestra.run.smithi196.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2023-11-08T19:53:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77407.log 2023-11-08T19:53:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77343.log.gz 2023-11-08T19:53:54.430 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57545.log 2023-11-08T19:53:54.431 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68270.log.gz 2023-11-08T19:53:54.431 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55747.log 2023-11-08T19:53:54.431 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77407.log.gz 2023-11-08T19:53:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67625.log 2023-11-08T19:53:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57545.log.gz 2023-11-08T19:53:54.432 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.55747.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68695.log 2023-11-08T19:53:54.432 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55747.log.gz 2023-11-08T19:53:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71069.log 2023-11-08T19:53:54.433 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67625.log.gz 2023-11-08T19:53:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68353.log 2023-11-08T19:53:54.433 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68695.log.gz 2023-11-08T19:53:54.434 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47004.log 2023-11-08T19:53:54.434 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71069.log.gz 2023-11-08T19:53:54.434 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54359.log 2023-11-08T19:53:54.434 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68353.log.gz 2023-11-08T19:53:54.435 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48953.log 2023-11-08T19:53:54.435 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2023-11-08T19:53:54.435 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55877.log 2023-11-08T19:53:54.436 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54359.log.gz 2023-11-08T19:53:54.436 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78707.log 2023-11-08T19:53:54.436 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48953.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74945.log 2023-11-08T19:53:54.436 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2023-11-08T19:53:54.437 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46323.log 2023-11-08T19:53:54.437 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55877.log.gz 2023-11-08T19:53:54.437 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78707.log.gz 2023-11-08T19:53:54.437 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69240.log 2023-11-08T19:53:54.438 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74945.log.gz 2023-11-08T19:53:54.438 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64421.log 2023-11-08T19:53:54.438 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46323.log.gz 2023-11-08T19:53:54.439 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70439.log 2023-11-08T19:53:54.439 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69240.log.gz 2023-11-08T19:53:54.439 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64421.log.gz 2023-11-08T19:53:54.439 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76273.log 2023-11-08T19:53:54.440 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70439.log.gz 2023-11-08T19:53:54.440 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66503.log 2023-11-08T19:53:54.440 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79440.log 2023-11-08T19:53:54.440 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76273.log.gz 2023-11-08T19:53:54.441 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2023-11-08T19:53:54.441 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66503.log.gz 2023-11-08T19:53:54.441 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2023-11-08T19:53:54.441 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79440.log.gz 2023-11-08T19:53:54.442 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58398.log 2023-11-08T19:53:54.442 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2023-11-08T19:53:54.442 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71129.log 2023-11-08T19:53:54.443 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49315.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2023-11-08T19:53:54.443 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41137.log 2023-11-08T19:53:54.443 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58398.log.gz 2023-11-08T19:53:54.443 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71129.log.gz 2023-11-08T19:53:54.444 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52240.log 2023-11-08T19:53:54.444 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58312.log 2023-11-08T19:53:54.444 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41137.log.gz 2023-11-08T19:53:54.445 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2023-11-08T19:53:54.445 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52240.log.gz 2023-11-08T19:53:54.445 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73159.log 2023-11-08T19:53:54.445 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58312.log.gz 2023-11-08T19:53:54.446 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.43156.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42137.log 2023-11-08T19:53:54.446 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2023-11-08T19:53:54.446 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64164.log 2023-11-08T19:53:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73159.log: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.73159.log.gz 2023-11-08T19:53:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39131.log 2023-11-08T19:53:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42137.log.gz 2023-11-08T19:53:54.447 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64164.log.gz 2023-11-08T19:53:54.448 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39024.log 2023-11-08T19:53:54.448 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.39131.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2023-11-08T19:53:54.448 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39131.log.gz 2023-11-08T19:53:54.449 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61879.log 2023-11-08T19:53:54.449 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39024.log.gz 2023-11-08T19:53:54.449 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44108.log 2023-11-08T19:53:54.449 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2023-11-08T19:53:54.450 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72353.log 2023-11-08T19:53:54.450 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61879.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.61879.log.gz 2023-11-08T19:53:54.450 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2023-11-08T19:53:54.453 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44108.log.gz 2023-11-08T19:53:54.454 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72353.log.gz 2023-11-08T19:53:54.454 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2023-11-08T19:53:54.454 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2023-11-08T19:53:54.454 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2023-11-08T19:53:54.455 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30122.log 2023-11-08T19:53:54.455 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2023-11-08T19:53:54.455 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2023-11-08T19:53:54.456 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2023-11-08T19:53:54.456 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-08T19:53:54.456 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.30122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30122.log.gz 2023-11-08T19:53:54.456 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53362.log /var/log/ceph/ceph-client.admin.53590.log: 2023-11-08T19:53:54.457 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2023-11-08T19:53:54.457 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62568.log 2023-11-08T19:53:54.457 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2023-11-08T19:53:54.457 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53362.log.gz 2023-11-08T19:53:54.458 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62568.log.gz 2023-11-08T19:53:54.458 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63500.log 2023-11-08T19:53:54.458 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69626.log 2023-11-08T19:53:54.459 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39548.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2023-11-08T19:53:54.459 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63500.log.gz 2023-11-08T19:53:54.459 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75874.log 2023-11-08T19:53:54.459 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2023-11-08T19:53:54.460 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69626.log.gz 2023-11-08T19:53:54.460 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75874.log.gz 2023-11-08T19:53:54.460 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56433.log 2023-11-08T19:53:54.460 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61211.log 2023-11-08T19:53:54.461 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2023-11-08T19:53:54.461 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2023-11-08T19:53:54.461 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56433.log.gz 2023-11-08T19:53:54.461 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78491.log 2023-11-08T19:53:54.462 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61211.log.gz 2023-11-08T19:53:54.462 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2023-11-08T19:53:54.462 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54079.log 2023-11-08T19:53:54.463 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78491.log: /var/log/ceph/ceph-client.admin.64379.log 2023-11-08T19:53:54.463 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78491.log.gz 2023-11-08T19:53:54.463 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.54079.log: --verbose -- /var/log/ceph/ceph-client.admin.58527.log 2023-11-08T19:53:54.463 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54079.log.gz 2023-11-08T19:53:54.464 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34606.log 2023-11-08T19:53:54.464 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64379.log.gz 2023-11-08T19:53:54.464 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76466.log 2023-11-08T19:53:54.464 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58527.log.gz 2023-11-08T19:53:54.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34606.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34606.log.gz 2023-11-08T19:53:54.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76894.log 2023-11-08T19:53:54.465 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2023-11-08T19:53:54.465 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76466.log.gz 2023-11-08T19:53:54.466 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.76894.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2023-11-08T19:53:54.466 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76894.log.gz 2023-11-08T19:53:54.466 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56196.log 2023-11-08T19:53:54.467 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2023-11-08T19:53:54.467 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2023-11-08T19:53:54.467 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39871.log 2023-11-08T19:53:54.467 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48753.log 2023-11-08T19:53:54.468 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56196.log: gzip /var/log/ceph/ceph-client.admin.39871.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77429.log 2023-11-08T19:53:54.468 INFO:teuthology.orchestra.run.smithi196.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.56196.log.gz 2023-11-08T19:53:54.468 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39871.log.gz 2023-11-08T19:53:54.468 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34854.log 2023-11-08T19:53:54.469 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48753.log.gz 2023-11-08T19:53:54.469 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51582.log 2023-11-08T19:53:54.469 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77429.log.gz 2023-11-08T19:53:54.469 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36353.log 2023-11-08T19:53:54.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34854.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37066.log 2023-11-08T19:53:54.470 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.470 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51582.log.gz 2023-11-08T19:53:54.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72891.log 2023-11-08T19:53:54.471 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36353.log.gz 2023-11-08T19:53:54.471 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69906.log 2023-11-08T19:53:54.471 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37066.log.gz 2023-11-08T19:53:54.472 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61441.log 2023-11-08T19:53:54.472 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72891.log.gz 2023-11-08T19:53:54.472 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69906.log.gz 2023-11-08T19:53:54.472 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35844.log 2023-11-08T19:53:54.473 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61441.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.61441.log.gz 2023-11-08T19:53:54.473 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76850.log 2023-11-08T19:53:54.473 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.35844.log: -- /var/log/ceph/ceph-client.admin.39616.log 2023-11-08T19:53:54.474 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35844.log.gz 2023-11-08T19:53:54.474 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.76850.log: --verbose -- /var/log/ceph/ceph-client.admin.51939.log 2023-11-08T19:53:54.474 INFO:teuthology.orchestra.run.smithi196.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.76850.log.gz 2023-11-08T19:53:54.474 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2023-11-08T19:53:54.475 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39616.log.gz 2023-11-08T19:53:54.475 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51939.log.gz 2023-11-08T19:53:54.475 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66280.log 2023-11-08T19:53:54.475 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75182.log 2023-11-08T19:53:54.476 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2023-11-08T19:53:54.476 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54445.log 2023-11-08T19:53:54.476 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66280.log.gz 2023-11-08T19:53:54.476 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79247.log 2023-11-08T19:53:54.477 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75182.log.gz 2023-11-08T19:53:54.477 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54445.log.gz 2023-11-08T19:53:54.477 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44997.log 2023-11-08T19:53:54.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79247.log.gz 2023-11-08T19:53:54.478 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41637.log 2023-11-08T19:53:54.478 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44892.log 2023-11-08T19:53:54.478 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44997.log.gz 2023-11-08T19:53:54.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.41637.log: -- /var/log/ceph/ceph-client.admin.52587.log 2023-11-08T19:53:54.479 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41637.log.gz 2023-11-08T19:53:54.479 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44892.log.gz 2023-11-08T19:53:54.479 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61944.log 2023-11-08T19:53:54.480 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52587.log.gz 2023-11-08T19:53:54.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69061.log 2023-11-08T19:53:54.480 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78007.log 2023-11-08T19:53:54.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61944.log.gz 2023-11-08T19:53:54.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69061.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33680.log 2023-11-08T19:53:54.481 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69061.log.gz 2023-11-08T19:53:54.481 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78007.log.gz 2023-11-08T19:53:54.482 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52175.log 2023-11-08T19:53:54.482 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33680.log.gz 2023-11-08T19:53:54.482 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62418.log 2023-11-08T19:53:54.482 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73698.log 2023-11-08T19:53:54.483 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52175.log.gz 2023-11-08T19:53:54.483 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.62418.log: --verbose -- /var/log/ceph/ceph-client.admin.38917.log 2023-11-08T19:53:54.483 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62418.log.gz 2023-11-08T19:53:54.483 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2023-11-08T19:53:54.484 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73698.log.gz 2023-11-08T19:53:54.484 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38917.log.gz 2023-11-08T19:53:54.484 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76251.log 2023-11-08T19:53:54.484 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55564.log 2023-11-08T19:53:54.485 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47413.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61336.log /var/log/ceph/ceph-client.admin.76251.log: 2023-11-08T19:53:54.485 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz 2023-11-08T19:53:54.485 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76251.log.gz 2023-11-08T19:53:54.486 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55564.log.gz 2023-11-08T19:53:54.486 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72289.log 2023-11-08T19:53:54.486 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66184.log 2023-11-08T19:53:54.486 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61336.log.gz 2023-11-08T19:53:54.487 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2023-11-08T19:53:54.487 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72289.log.gz 2023-11-08T19:53:54.487 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49698.log 2023-11-08T19:53:54.488 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66184.log.gz 2023-11-08T19:53:54.488 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40415.log 2023-11-08T19:53:54.488 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2023-11-08T19:53:54.488 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60320.log 2023-11-08T19:53:54.489 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49698.log.gz 2023-11-08T19:53:54.489 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64438.log 2023-11-08T19:53:54.489 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40415.log: 1.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75834.log 2023-11-08T19:53:54.489 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40415.log.gz 2023-11-08T19:53:54.490 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60320.log.gz 2023-11-08T19:53:54.490 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79602.log 2023-11-08T19:53:54.490 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64438.log.gz 2023-11-08T19:53:54.491 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75834.log: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.75834.log.gz 2023-11-08T19:53:54.491 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2023-11-08T19:53:54.491 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54915.log 2023-11-08T19:53:54.491 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79602.log.gz 2023-11-08T19:53:54.492 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55828.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64357.log 2023-11-08T19:53:54.492 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2023-11-08T19:53:54.492 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61191.log 2023-11-08T19:53:54.492 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54915.log.gz 2023-11-08T19:53:54.493 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64357.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60449.log 2023-11-08T19:53:54.493 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64357.log.gz 2023-11-08T19:53:54.493 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33788.log 2023-11-08T19:53:54.494 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61191.log.gz 2023-11-08T19:53:54.494 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60449.log.gz 2023-11-08T19:53:54.494 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80008.log 2023-11-08T19:53:54.494 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33788.log.gz 2023-11-08T19:53:54.495 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2023-11-08T19:53:54.495 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55119.log 2023-11-08T19:53:54.495 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80008.log.gz 2023-11-08T19:53:54.495 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.42877.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2023-11-08T19:53:54.496 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2023-11-08T19:53:54.496 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34503.log 2023-11-08T19:53:54.496 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55119.log.gz 2023-11-08T19:53:54.497 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2023-11-08T19:53:54.497 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2023-11-08T19:53:54.497 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69946.log 2023-11-08T19:53:54.497 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34503.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34503.log.gz 2023-11-08T19:53:54.498 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50444.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2023-11-08T19:53:54.498 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44074.log 2023-11-08T19:53:54.498 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69946.log: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.69946.log.gz 2023-11-08T19:53:54.498 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74107.log 2023-11-08T19:53:54.499 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47305.log 2023-11-08T19:53:54.499 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2023-11-08T19:53:54.499 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2023-11-08T19:53:54.500 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74107.log.gz 2023-11-08T19:53:54.500 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47305.log.gz 2023-11-08T19:53:54.500 INFO:teuthology.orchestra.run.smithi196.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-08T19:53:54.500 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36680.log 2023-11-08T19:53:54.501 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41417.log 2023-11-08T19:53:54.501 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2023-11-08T19:53:54.501 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63820.log 2023-11-08T19:53:54.501 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36680.log.gz 2023-11-08T19:53:54.502 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41417.log.gz 2023-11-08T19:53:54.502 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2023-11-08T19:53:54.502 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63820.log.gz 2023-11-08T19:53:54.503 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69044.log 2023-11-08T19:53:54.503 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54595.log 2023-11-08T19:53:54.503 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2023-11-08T19:53:54.503 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74386.log 2023-11-08T19:53:54.504 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69044.log.gz 2023-11-08T19:53:54.504 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2023-11-08T19:53:54.504 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54595.log.gz 2023-11-08T19:53:54.505 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2023-11-08T19:53:54.505 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74386.log.gz 2023-11-08T19:53:54.505 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55626.log 2023-11-08T19:53:54.505 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2023-11-08T19:53:54.506 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67991.log 2023-11-08T19:53:54.506 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2023-11-08T19:53:54.506 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74709.log 2023-11-08T19:53:54.506 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55626.log.gz 2023-11-08T19:53:54.507 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67991.log.gz 2023-11-08T19:53:54.507 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2023-11-08T19:53:54.507 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69119.log 2023-11-08T19:53:54.508 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74709.log.gz 2023-11-08T19:53:54.508 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.48060.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.80656.log 2023-11-08T19:53:54.508 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2023-11-08T19:53:54.508 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52132.log 2023-11-08T19:53:54.509 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69119.log.gz 2023-11-08T19:53:54.509 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70723.log 2023-11-08T19:53:54.509 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80656.log.gz 2023-11-08T19:53:54.509 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2023-11-08T19:53:54.510 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52132.log.gz 2023-11-08T19:53:54.510 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2023-11-08T19:53:54.510 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70723.log.gz 2023-11-08T19:53:54.511 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.36551.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2023-11-08T19:53:54.511 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2023-11-08T19:53:54.511 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66399.log 2023-11-08T19:53:54.511 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gz 2023-11-08T19:53:54.512 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73062.log 2023-11-08T19:53:54.512 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49198.log: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2023-11-08T19:53:54.512 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75676.log 2023-11-08T19:53:54.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66399.log.gz 2023-11-08T19:53:54.513 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49456.log 2023-11-08T19:53:54.513 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73062.log.gz 2023-11-08T19:53:54.513 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44312.log 2023-11-08T19:53:54.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75676.log.gz 2023-11-08T19:53:54.514 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52003.log 2023-11-08T19:53:54.514 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49456.log.gz 2023-11-08T19:53:54.514 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66070.log 2023-11-08T19:53:54.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44312.log.gz 2023-11-08T19:53:54.515 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59911.log 2023-11-08T19:53:54.515 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52003.log.gz 2023-11-08T19:53:54.516 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38508.log 2023-11-08T19:53:54.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66070.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.66070.log.gz-- 2023-11-08T19:53:54.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57439.log 2023-11-08T19:53:54.516 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59911.log.gz 2023-11-08T19:53:54.517 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59677.log 2023-11-08T19:53:54.517 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38508.log.gz 2023-11-08T19:53:54.517 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41117.log 2023-11-08T19:53:54.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57439.log.gz 2023-11-08T19:53:54.518 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43326.log 2023-11-08T19:53:54.518 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2023-11-08T19:53:54.518 INFO:teuthology.orchestra.run.smithi196.stderr: 53.0% -- replaced with /var/log/ceph/ceph-client.admin.59677.log.gz 2023-11-08T19:53:54.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41117.log.gz 2023-11-08T19:53:54.519 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55474.log 2023-11-08T19:53:54.519 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43326.log.gz 2023-11-08T19:53:54.519 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71501.log 2023-11-08T19:53:54.520 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47733.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54509.log /var/log/ceph/ceph-client.admin.55474.log: 2023-11-08T19:53:54.520 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2023-11-08T19:53:54.520 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55474.log.gz 2023-11-08T19:53:54.521 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47456.log 2023-11-08T19:53:54.521 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71501.log.gz 2023-11-08T19:53:54.521 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60517.log 2023-11-08T19:53:54.521 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54509.log.gz 2023-11-08T19:53:54.522 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.47456.log: -- /var/log/ceph/ceph-client.admin.74838.log 2023-11-08T19:53:54.522 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47456.log.gz 2023-11-08T19:53:54.522 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53211.log 2023-11-08T19:53:54.522 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60517.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43343.log 2023-11-08T19:53:54.523 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.523 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74838.log.gz/var/log/ceph/ceph-client.admin.53211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57481.log 2023-11-08T19:53:54.523 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.524 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53211.log.gz 2023-11-08T19:53:54.524 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53341.log 2023-11-08T19:53:54.524 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43343.log.gz 2023-11-08T19:53:54.524 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2023-11-08T19:53:54.525 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57481.log.gz/var/log/ceph/ceph-client.admin.53341.log: 2023-11-08T19:53:54.525 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61275.log 2023-11-08T19:53:54.525 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53341.log.gz 2023-11-08T19:53:54.526 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74881.log 2023-11-08T19:53:54.526 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38831.log 2023-11-08T19:53:54.526 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2023-11-08T19:53:54.526 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61275.log.gz 2023-11-08T19:53:54.527 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39480.log 2023-11-08T19:53:54.527 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74881.log.gz 2023-11-08T19:53:54.527 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59976.log 2023-11-08T19:53:54.527 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38831.log.gz 2023-11-08T19:53:54.528 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49077.log 2023-11-08T19:53:54.528 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39480.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39480.log.gz 2023-11-08T19:53:54.528 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33659.log 2023-11-08T19:53:54.529 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59976.log.gz 2023-11-08T19:53:54.529 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2023-11-08T19:53:54.529 INFO:teuthology.orchestra.run.smithi196.stderr: 22.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65423.log 2023-11-08T19:53:54.529 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49077.log.gz 2023-11-08T19:53:54.530 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33659.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50724.log 2023-11-08T19:53:54.530 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33659.log.gz/var/log/ceph/ceph-client.admin.44397.log: 2023-11-08T19:53:54.530 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2023-11-08T19:53:54.530 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2023-11-08T19:53:54.531 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65423.log.gz 2023-11-08T19:53:54.531 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38573.log 2023-11-08T19:53:54.531 INFO:teuthology.orchestra.run.smithi196.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.50724.log.gz 2023-11-08T19:53:54.532 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2023-11-08T19:53:54.532 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2023-11-08T19:53:54.532 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35371.log 2023-11-08T19:53:54.532 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38573.log.gz 2023-11-08T19:53:54.533 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56670.log 2023-11-08T19:53:54.533 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2023-11-08T19:53:54.533 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39735.log 2023-11-08T19:53:54.534 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35371.log.gz 2023-11-08T19:53:54.534 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80602.log 2023-11-08T19:53:54.534 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56670.log.gz 2023-11-08T19:53:54.534 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68120.log 2023-11-08T19:53:54.535 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39735.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39735.log.gz 2023-11-08T19:53:54.535 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39922.log 2023-11-08T19:53:54.535 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80602.log.gz 2023-11-08T19:53:54.535 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68077.log 2023-11-08T19:53:54.536 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68120.log: /var/log/ceph/ceph-client.admin.39922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73367.log 2023-11-08T19:53:54.536 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68120.log.gz 2023-11-08T19:53:54.536 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39922.log.gz 2023-11-08T19:53:54.536 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40977.log 2023-11-08T19:53:54.537 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68077.log.gz 2023-11-08T19:53:54.537 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66462.log 2023-11-08T19:53:54.537 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73367.log.gz 2023-11-08T19:53:54.538 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67453.log 2023-11-08T19:53:54.538 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40977.log.gz 2023-11-08T19:53:54.538 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50964.log 2023-11-08T19:53:54.538 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66462.log.gz 2023-11-08T19:53:54.539 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49617.log 2023-11-08T19:53:54.539 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67453.log.gz 2023-11-08T19:53:54.539 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70955.log 2023-11-08T19:53:54.540 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50964.log.gz 2023-11-08T19:53:54.540 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41877.log 2023-11-08T19:53:54.540 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49617.log: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.49617.log.gz 2023-11-08T19:53:54.540 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33365.log 2023-11-08T19:53:54.541 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70955.log.gz 2023-11-08T19:53:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69743.log 2023-11-08T19:53:54.541 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41877.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45564.log 2023-11-08T19:53:54.541 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41877.log.gz/var/log/ceph/ceph-client.admin.33365.log: 2023-11-08T19:53:54.542 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33365.log.gz 2023-11-08T19:53:54.542 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80197.log 2023-11-08T19:53:54.542 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69743.log.gz 2023-11-08T19:53:54.543 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2023-11-08T19:53:54.543 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45564.log.gz 2023-11-08T19:53:54.543 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73244.log 2023-11-08T19:53:54.543 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74988.log 2023-11-08T19:53:54.544 INFO:teuthology.orchestra.run.smithi196.stderr: 27.2% -- replaced with /var/log/ceph/ceph-client.admin.80197.log.gz 2023-11-08T19:53:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40738.log: /var/log/ceph/ceph-client.admin.73244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2023-11-08T19:53:54.544 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38339.log 2023-11-08T19:53:54.544 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73244.log.gz 2023-11-08T19:53:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38014.log 2023-11-08T19:53:54.545 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74988.log: /var/log/ceph/ceph-client.admin.38339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80494.log 2023-11-08T19:53:54.545 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74988.log.gz 2023-11-08T19:53:54.545 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38339.log.gz 2023-11-08T19:53:54.546 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63734.log 2023-11-08T19:53:54.546 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38014.log.gz 2023-11-08T19:53:54.546 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48189.log 2023-11-08T19:53:54.546 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80494.log.gz 2023-11-08T19:53:54.547 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67152.log 2023-11-08T19:53:54.547 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63734.log.gz 2023-11-08T19:53:54.547 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2023-11-08T19:53:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48189.log.gz 2023-11-08T19:53:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 /var/log/ceph/ceph-client.admin.67152.log: --verbose -- /var/log/ceph/ceph-client.admin.75074.log 2023-11-08T19:53:54.548 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67152.log.gz 2023-11-08T19:53:54.548 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69027.log 2023-11-08T19:53:54.549 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2023-11-08T19:53:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70459.log 2023-11-08T19:53:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75074.log.gz 2023-11-08T19:53:54.549 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.69027.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67238.log 2023-11-08T19:53:54.550 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69027.log.gz 2023-11-08T19:53:54.550 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35973.log 2023-11-08T19:53:54.550 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70459.log.gz 2023-11-08T19:53:54.551 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36980.log 2023-11-08T19:53:54.551 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67238.log.gz 2023-11-08T19:53:54.551 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76165.log 2023-11-08T19:53:54.551 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35973.log.gz 2023-11-08T19:53:54.552 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2023-11-08T19:53:54.552 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36980.log.gz 2023-11-08T19:53:54.552 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48555.log 2023-11-08T19:53:54.553 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76165.log.gz 2023-11-08T19:53:54.553 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.33501.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43921.log 2023-11-08T19:53:54.553 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2023-11-08T19:53:54.553 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33831.log 2023-11-08T19:53:54.554 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48555.log.gz 2023-11-08T19:53:54.554 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78464.log 2023-11-08T19:53:54.554 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43921.log.gz 2023-11-08T19:53:54.555 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64928.log 2023-11-08T19:53:54.555 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33831.log.gz 2023-11-08T19:53:54.555 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78464.log: /var/log/ceph/ceph-client.admin.48232.log 2023-11-08T19:53:54.555 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78464.log.gz 2023-11-08T19:53:54.556 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76187.log 2023-11-08T19:53:54.556 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.64928.log.gz 2023-11-08T19:53:54.556 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2023-11-08T19:53:54.556 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48232.log.gz 2023-11-08T19:53:54.557 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2023-11-08T19:53:54.557 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76187.log.gz 2023-11-08T19:53:54.557 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73870.log 2023-11-08T19:53:54.558 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2023-11-08T19:53:54.558 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37517.log 2023-11-08T19:53:54.558 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2023-11-08T19:53:54.559 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63354.log 2023-11-08T19:53:54.559 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73870.log.gz 2023-11-08T19:53:54.559 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48404.log 2023-11-08T19:53:54.559 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37517.log.gz 2023-11-08T19:53:54.560 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58269.log 2023-11-08T19:53:54.560 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63354.log.gz 2023-11-08T19:53:54.560 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49218.log 2023-11-08T19:53:54.561 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48404.log.gz 2023-11-08T19:53:54.561 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70704.log 2023-11-08T19:53:54.561 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58269.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67819.log 2023-11-08T19:53:54.561 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58269.log.gz 2023-11-08T19:53:54.562 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74558.log 2023-11-08T19:53:54.562 INFO:teuthology.orchestra.run.smithi196.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.49218.log.gz 2023-11-08T19:53:54.562 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70704.log.gz 2023-11-08T19:53:54.562 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79358.log 2023-11-08T19:53:54.563 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67819.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70972.log 2023-11-08T19:53:54.563 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67819.log.gz 2023-11-08T19:53:54.563 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74558.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74558.log.gz-5 2023-11-08T19:53:54.564 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.39327.log 2023-11-08T19:53:54.564 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79358.log.gz 2023-11-08T19:53:54.564 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66546.log 2023-11-08T19:53:54.564 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70972.log.gzgzip 2023-11-08T19:53:54.565 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.35629.log 2023-11-08T19:53:54.565 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.39327.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39327.log.gz 2023-11-08T19:53:54.565 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54036.log 2023-11-08T19:53:54.565 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66546.log.gz 2023-11-08T19:53:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60658.log 2023-11-08T19:53:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35629.log.gz 2023-11-08T19:53:54.566 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62116.log 2023-11-08T19:53:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54036.log.gz 2023-11-08T19:53:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69609.log 2023-11-08T19:53:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log 2023-11-08T19:53:54.567 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60658.log.gz 2023-11-08T19:53:54.568 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62116.log.gz 2023-11-08T19:53:54.568 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34545.log 2023-11-08T19:53:54.568 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69609.log.gz 2023-11-08T19:53:54.568 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51853.log 2023-11-08T19:53:54.569 INFO:teuthology.orchestra.run.smithi196.stderr: 54.8% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2023-11-08T19:53:54.569 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44380.log 2023-11-08T19:53:54.569 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34545.log.gz 2023-11-08T19:53:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36255.log 2023-11-08T19:53:54.570 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51853.log.gz 2023-11-08T19:53:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2023-11-08T19:53:54.570 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44380.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73387.log 2023-11-08T19:53:54.571 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36255.log: -- replaced with /var/log/ceph/ceph-client.admin.44380.log.gz 2023-11-08T19:53:54.571 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36255.log.gz 2023-11-08T19:53:54.571 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74021.log 2023-11-08T19:53:54.571 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2023-11-08T19:53:54.572 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80900.log 2023-11-08T19:53:54.572 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73387.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2023-11-08T19:53:54.572 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73387.log.gz 2023-11-08T19:53:54.573 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74021.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58076.log 2023-11-08T19:53:54.573 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80900.log: -- replaced with /var/log/ceph/ceph-client.admin.74021.log.gz 2023-11-08T19:53:54.573 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80900.log.gz 2023-11-08T19:53:54.573 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76617.log 2023-11-08T19:53:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2023-11-08T19:53:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80305.log 2023-11-08T19:53:54.574 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70255.log 2023-11-08T19:53:54.574 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58076.log.gz 2023-11-08T19:53:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76617.log.gz 2023-11-08T19:53:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2023-11-08T19:53:54.575 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80305.log.gz 2023-11-08T19:53:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2023-11-08T19:53:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70255.log.gz 2023-11-08T19:53:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2023-11-08T19:53:54.576 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62482.log 2023-11-08T19:53:54.577 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52347.log 2023-11-08T19:53:54.577 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2023-11-08T19:53:54.577 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2023-11-08T19:53:54.577 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62482.log.gz 2023-11-08T19:53:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2023-11-08T19:53:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52347.log.gz 2023-11-08T19:53:54.578 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2023-11-08T19:53:54.579 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2023-11-08T19:53:54.579 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35586.log 2023-11-08T19:53:54.579 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2023-11-08T19:53:54.579 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55898.log 2023-11-08T19:53:54.580 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2023-11-08T19:53:54.580 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73978.log 2023-11-08T19:53:54.580 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35586.log.gz 2023-11-08T19:53:54.580 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60126.log 2023-11-08T19:53:54.581 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55898.log.gz 2023-11-08T19:53:54.581 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41477.log 2023-11-08T19:53:54.581 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73978.log.gz 2023-11-08T19:53:54.582 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2023-11-08T19:53:54.582 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67410.log 2023-11-08T19:53:54.582 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60126.log.gz 2023-11-08T19:53:54.582 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41477.log.gz 2023-11-08T19:53:54.583 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63480.log 2023-11-08T19:53:54.583 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51262.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2023-11-08T19:53:54.583 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52519.log 2023-11-08T19:53:54.583 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67410.log.gz 2023-11-08T19:53:54.584 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2023-11-08T19:53:54.584 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63480.log.gz 2023-11-08T19:53:54.584 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64542.log 2023-11-08T19:53:54.584 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52519.log.gz 2023-11-08T19:53:54.585 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37496.log 2023-11-08T19:53:54.585 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47562.log: gzip 2.5% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz-5 2023-11-08T19:53:54.585 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.40058.log 2023-11-08T19:53:54.586 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64542.log.gz 2023-11-08T19:53:54.586 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75592.log 2023-11-08T19:53:54.586 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37496.log.gz 2023-11-08T19:53:54.586 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79058.log 2023-11-08T19:53:54.587 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40058.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40058.log.gz 2023-11-08T19:53:54.587 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55140.log 2023-11-08T19:53:54.587 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75592.log: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.75592.log.gz 2023-11-08T19:53:54.588 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43989.log 2023-11-08T19:53:54.588 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33874.log 2023-11-08T19:53:54.588 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79058.log.gz 2023-11-08T19:53:54.588 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55140.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65714.log 2023-11-08T19:53:54.589 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55140.log.gz 2023-11-08T19:53:54.589 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56971.log 2023-11-08T19:53:54.589 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33874.log: 2023-11-08T19:53:54.589 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33874.log.gz 2023-11-08T19:53:54.590 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2023-11-08T19:53:54.590 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65714.log.gz 2023-11-08T19:53:54.590 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81386.log 2023-11-08T19:53:54.591 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56971.log.gz 2023-11-08T19:53:54.591 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2023-11-08T19:53:54.591 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2023-11-08T19:53:54.591 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.81386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46071.log 2023-11-08T19:53:54.592 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.81386.log.gz 2023-11-08T19:53:54.592 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2023-11-08T19:53:54.592 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61987.log 2023-11-08T19:53:54.592 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2023-11-08T19:53:54.593 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2023-11-08T19:53:54.593 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46071.log.gz 2023-11-08T19:53:54.593 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz 2023-11-08T19:53:54.594 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.61987.log: -- /var/log/ceph/ceph-client.admin.44125.log 2023-11-08T19:53:54.594 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61987.log.gz 2023-11-08T19:53:54.594 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52046.log 2023-11-08T19:53:54.594 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2023-11-08T19:53:54.595 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77708.log 2023-11-08T19:53:54.595 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2023-11-08T19:53:54.595 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56175.log 2023-11-08T19:53:54.595 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52046.log.gz 2023-11-08T19:53:54.596 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38659.log 2023-11-08T19:53:54.596 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77708.log.gz 2023-11-08T19:53:54.596 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2023-11-08T19:53:54.597 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56175.log.gz 2023-11-08T19:53:54.597 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59697.log 2023-11-08T19:53:54.597 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38659.log.gz 2023-11-08T19:53:54.597 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80062.log 2023-11-08T19:53:54.598 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2023-11-08T19:53:54.598 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70602.log 2023-11-08T19:53:54.598 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.59697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59697.log.gz 2023-11-08T19:53:54.598 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56454.log 2023-11-08T19:53:54.599 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80062.log.gz 2023-11-08T19:53:54.599 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69081.log 2023-11-08T19:53:54.599 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70602.log: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.70602.log.gz 2023-11-08T19:53:54.599 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56025.log 2023-11-08T19:53:54.600 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56454.log.gz 2023-11-08T19:53:54.600 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42017.log 2023-11-08T19:53:54.600 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69081.log.gz 2023-11-08T19:53:54.601 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65014.log 2023-11-08T19:53:54.601 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56025.log.gz 2023-11-08T19:53:54.601 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51100.log 2023-11-08T19:53:54.601 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42017.log.gz 2023-11-08T19:53:54.602 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40160.log 2023-11-08T19:53:54.602 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65014.log.gz 2023-11-08T19:53:54.602 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47155.log 2023-11-08T19:53:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51100.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.51100.log.gz 2023-11-08T19:53:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60737.log 2023-11-08T19:53:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40160.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40160.log.gz 2023-11-08T19:53:54.603 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.47155.log: -- /var/log/ceph/ceph-client.admin.68967.log 2023-11-08T19:53:54.604 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47155.log.gz 2023-11-08T19:53:54.604 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73327.log 2023-11-08T19:53:54.604 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60737.log.gz 2023-11-08T19:53:54.604 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32777.log 2023-11-08T19:53:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68967.log.gz 2023-11-08T19:53:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2023-11-08T19:53:54.605 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73327.log.gz 2023-11-08T19:53:54.606 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45777.log 2023-11-08T19:53:54.606 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.32777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32777.log.gz 2023-11-08T19:53:54.606 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2023-11-08T19:53:54.606 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2023-11-08T19:53:54.607 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2023-11-08T19:53:54.607 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45777.log.gz 2023-11-08T19:53:54.607 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58097.log 2023-11-08T19:53:54.607 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2023-11-08T19:53:54.608 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2023-11-08T19:53:54.608 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2023-11-08T19:53:54.608 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2023-11-08T19:53:54.609 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.58097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58097.log.gz 2023-11-08T19:53:54.609 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60363.log 2023-11-08T19:53:54.609 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2023-11-08T19:53:54.609 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50704.log 2023-11-08T19:53:54.610 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2023-11-08T19:53:54.610 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63459.log 2023-11-08T19:53:54.610 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60363.log.gz 2023-11-08T19:53:54.610 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2023-11-08T19:53:54.611 INFO:teuthology.orchestra.run.smithi196.stderr: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.50704.log.gz 2023-11-08T19:53:54.611 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37173.log 2023-11-08T19:53:54.611 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63459.log.gz 2023-11-08T19:53:54.612 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51682.log 2023-11-08T19:53:54.612 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43462.log: /var/log/ceph/ceph-client.admin.37173.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.54488.log -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2023-11-08T19:53:54.612 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:53:54.612 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37173.log.gz 2023-11-08T19:53:54.613 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2023-11-08T19:53:54.613 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51682.log.gz 2023-11-08T19:53:54.613 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2023-11-08T19:53:54.613 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77536.log 2023-11-08T19:53:54.614 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54488.log.gz 2023-11-08T19:53:54.614 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2023-11-08T19:53:54.614 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50663.log 2023-11-08T19:53:54.614 INFO:teuthology.orchestra.run.smithi196.stderr: 57.9% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2023-11-08T19:53:54.615 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66916.log 2023-11-08T19:53:54.615 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77536.log.gz 2023-11-08T19:53:54.615 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71581.log 2023-11-08T19:53:54.616 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50663.log.gz 2023-11-08T19:53:54.616 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2023-11-08T19:53:54.616 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66916.log.gz 2023-11-08T19:53:54.616 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47541.log 2023-11-08T19:53:54.617 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71581.log: /var/log/ceph/ceph-client.admin.39990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2023-11-08T19:53:54.617 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71581.log.gz 2023-11-08T19:53:54.617 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gz 2023-11-08T19:53:54.617 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51662.log 2023-11-08T19:53:54.617 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47541.log.gz 2023-11-08T19:53:54.618 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41177.log 2023-11-08T19:53:54.618 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48512.log: 0.0%/var/log/ceph/ceph-client.admin.51662.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2023-11-08T19:53:54.618 INFO:teuthology.orchestra.run.smithi196.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.61772.log 2023-11-08T19:53:54.619 INFO:teuthology.orchestra.run.smithi196.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.51662.log.gz 2023-11-08T19:53:54.619 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62955.log 2023-11-08T19:53:54.619 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41177.log.gz 2023-11-08T19:53:54.619 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70379.log 2023-11-08T19:53:54.619 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61772.log.gz 2023-11-08T19:53:54.620 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80764.log 2023-11-08T19:53:54.620 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62955.log.gz 2023-11-08T19:53:54.620 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46407.log 2023-11-08T19:53:54.621 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70379.log: /var/log/ceph/ceph-client.admin.80764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47047.log 2023-11-08T19:53:54.621 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70379.log.gz 2023-11-08T19:53:54.621 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80764.log.gz 2023-11-08T19:53:54.621 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.46407.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72998.log 2023-11-08T19:53:54.622 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46407.log.gz 2023-11-08T19:53:54.622 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72568.log 2023-11-08T19:53:54.622 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47047.log.gz 2023-11-08T19:53:54.622 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72955.log 2023-11-08T19:53:54.623 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72998.log.gz 2023-11-08T19:53:54.623 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54811.log 2023-11-08T19:53:54.623 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72568.log.gz 2023-11-08T19:53:54.623 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2023-11-08T19:53:54.624 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72955.log.gz 2023-11-08T19:53:54.624 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log 2023-11-08T19:53:54.624 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54811.log.gz 2023-11-08T19:53:54.624 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2023-11-08T19:53:54.625 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2023-11-08T19:53:54.625 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42935.log 2023-11-08T19:53:54.625 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51503.log.gz 2023-11-08T19:53:54.625 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45819.log 2023-11-08T19:53:54.626 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51021.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2023-11-08T19:53:54.626 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78842.log 2023-11-08T19:53:54.626 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42935.log.gz 2023-11-08T19:53:54.626 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66937.log 2023-11-08T19:53:54.627 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45819.log.gz 2023-11-08T19:53:54.627 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69783.log 2023-11-08T19:53:54.627 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78842.log.gz 2023-11-08T19:53:54.627 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2023-11-08T19:53:54.628 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66937.log.gz 2023-11-08T19:53:54.628 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.69783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63229.log 2023-11-08T19:53:54.628 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69783.log.gz 2023-11-08T19:53:54.628 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76423.log 2023-11-08T19:53:54.629 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.48619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2023-11-08T19:53:54.629 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.63229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2023-11-08T19:53:54.629 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63229.log.gz 2023-11-08T19:53:54.629 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56562.log 2023-11-08T19:53:54.630 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76423.log.gz 2023-11-08T19:53:54.630 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53695.log 2023-11-08T19:53:54.630 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2023-11-08T19:53:54.631 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42417.log 2023-11-08T19:53:54.631 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56562.log.gz 2023-11-08T19:53:54.631 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.53695.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74494.log 2023-11-08T19:53:54.631 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.53695.log.gz 2023-11-08T19:53:54.632 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2023-11-08T19:53:54.632 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42417.log.gz 2023-11-08T19:53:54.632 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.74494.log: -- /var/log/ceph/ceph-client.admin.66669.log 2023-11-08T19:53:54.632 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74494.log.gz 2023-11-08T19:53:54.633 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log 2023-11-08T19:53:54.633 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2023-11-08T19:53:54.633 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79193.log 2023-11-08T19:53:54.634 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66669.log.gz 2023-11-08T19:53:54.634 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80683.log 2023-11-08T19:53:54.634 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61399.log 2023-11-08T19:53:54.634 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2023-11-08T19:53:54.635 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80683.log: /var/log/ceph/ceph-client.admin.79413.log 2023-11-08T19:53:54.635 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79193.log.gz 2023-11-08T19:53:54.635 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80683.log.gz 2023-11-08T19:53:54.635 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.61399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65750.log 2023-11-08T19:53:54.636 INFO:teuthology.orchestra.run.smithi196.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.61399.log.gz 2023-11-08T19:53:54.636 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2023-11-08T19:53:54.636 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79413.log.gz 2023-11-08T19:53:54.636 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77085.log 2023-11-08T19:53:54.637 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.65750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65750.log.gz 2023-11-08T19:53:54.637 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37238.log 2023-11-08T19:53:54.637 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2023-11-08T19:53:54.638 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2023-11-08T19:53:54.638 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.77085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77085.log.gz 2023-11-08T19:53:54.638 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54660.log 2023-11-08T19:53:54.638 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37238.log.gz 2023-11-08T19:53:54.639 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74429.log 2023-11-08T19:53:54.639 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2023-11-08T19:53:54.639 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67088.log 2023-11-08T19:53:54.639 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54660.log.gz 2023-11-08T19:53:54.640 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.74429.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2023-11-08T19:53:54.640 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74429.log.gz 2023-11-08T19:53:54.640 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.67088.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.80332.log 2023-11-08T19:53:54.640 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67088.log.gz 2023-11-08T19:53:54.641 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2023-11-08T19:53:54.641 INFO:teuthology.orchestra.run.smithi196.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2023-11-08T19:53:54.641 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36637.log 2023-11-08T19:53:54.642 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80332.log.gz 2023-11-08T19:53:54.642 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53929.log 2023-11-08T19:53:54.642 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2023-11-08T19:53:54.642 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72150.log 2023-11-08T19:53:54.643 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36637.log.gz 2023-11-08T19:53:54.643 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55238.log 2023-11-08T19:53:54.643 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53929.log.gz 2023-11-08T19:53:54.644 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74042.log 2023-11-08T19:53:54.644 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72150.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.72150.log.gz 2023-11-08T19:53:54.644 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54638.log 2023-11-08T19:53:54.644 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55238.log.gz 2023-11-08T19:53:54.645 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61231.log 2023-11-08T19:53:54.645 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74042.log.gz 2023-11-08T19:53:54.645 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36594.log 2023-11-08T19:53:54.645 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54638.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78356.log 2023-11-08T19:53:54.646 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54638.log.gz/var/log/ceph/ceph-client.admin.61231.log: 2023-11-08T19:53:54.646 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61231.log.gz 2023-11-08T19:53:54.646 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2023-11-08T19:53:54.646 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36594.log.gz 2023-11-08T19:53:54.647 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51982.log 2023-11-08T19:53:54.647 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78356.log.gz 2023-11-08T19:53:54.647 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40211.log 2023-11-08T19:53:54.647 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53339.log 2023-11-08T19:53:54.648 INFO:teuthology.orchestra.run.smithi196.stderr: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2023-11-08T19:53:54.648 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51982.log.gz 2023-11-08T19:53:54.648 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75794.log 2023-11-08T19:53:54.648 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40211.log.gz 2023-11-08T19:53:54.649 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75509.log 2023-11-08T19:53:54.649 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.53339.log: /var/log/ceph/ceph-client.admin.75794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2023-11-08T19:53:54.649 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53339.log.gz 2023-11-08T19:53:54.650 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75794.log.gz 2023-11-08T19:53:54.650 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38874.log 2023-11-08T19:53:54.650 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75509.log.gz 2023-11-08T19:53:54.650 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60406.log 2023-11-08T19:53:54.651 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2023-11-08T19:53:54.651 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54101.log 2023-11-08T19:53:54.651 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38874.log.gz 2023-11-08T19:53:54.651 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51603.log 2023-11-08T19:53:54.652 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2023-11-08T19:53:54.652 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60406.log.gz 2023-11-08T19:53:54.652 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54101.log: 0.0%/var/log/ceph/ceph-client.admin.51603.log: -- replaced with /var/log/ceph/ceph-client.admin.54101.log.gz 2023-11-08T19:53:54.653 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48933.log 2023-11-08T19:53:54.653 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51603.log.gz 2023-11-08T19:53:54.653 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71541.log 2023-11-08T19:53:54.653 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41197.log: 0.0%/var/log/ceph/ceph-client.admin.48933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41957.log 2023-11-08T19:53:54.654 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2023-11-08T19:53:54.654 INFO:teuthology.orchestra.run.smithi196.stderr: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.48933.log.gz 2023-11-08T19:53:54.654 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64207.log 2023-11-08T19:53:54.655 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71541.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.71541.log.gz 2023-11-08T19:53:54.655 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46875.log 2023-11-08T19:53:54.655 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41957.log.gz 2023-11-08T19:53:54.655 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2023-11-08T19:53:54.656 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64207.log: /var/log/ceph/ceph-client.admin.46875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54952.log 2023-11-08T19:53:54.656 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64207.log.gz 2023-11-08T19:53:54.656 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46875.log.gz 2023-11-08T19:53:54.656 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41837.log 2023-11-08T19:53:54.657 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.49418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2023-11-08T19:53:54.657 INFO:teuthology.orchestra.run.smithi196.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2023-11-08T19:53:54.657 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.54952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54952.log.gz 2023-11-08T19:53:54.657 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50049.log 2023-11-08T19:53:54.658 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41837.log.gz 2023-11-08T19:53:54.658 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52802.log 2023-11-08T19:53:54.658 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2023-11-08T19:53:54.658 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56261.log 2023-11-08T19:53:54.659 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50049.log.gz 2023-11-08T19:53:54.659 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.52802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49677.log 2023-11-08T19:53:54.659 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52802.log.gz 2023-11-08T19:53:54.660 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34834.log 2023-11-08T19:53:54.660 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56261.log.gz 2023-11-08T19:53:54.660 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60840.log /var/log/ceph/ceph-client.admin.49677.log: 2023-11-08T19:53:54.660 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49677.log.gz 2023-11-08T19:53:54.661 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72131.log 2023-11-08T19:53:54.661 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34834.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34834.log.gz 2023-11-08T19:53:54.661 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2023-11-08T19:53:54.661 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60840.log.gz 2023-11-08T19:53:54.662 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57713.log 2023-11-08T19:53:54.662 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72131.log.gz 2023-11-08T19:53:54.662 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47262.log 2023-11-08T19:53:54.663 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.43445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2023-11-08T19:53:54.663 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55196.log 2023-11-08T19:53:54.663 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.57713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57713.log.gz 2023-11-08T19:53:54.663 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74859.log 2023-11-08T19:53:54.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.47262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47262.log.gz 2023-11-08T19:53:54.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78410.log 2023-11-08T19:53:54.664 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55196.log.gz 2023-11-08T19:53:54.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70915.log 2023-11-08T19:53:54.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74859.log.gz 2023-11-08T19:53:54.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72869.log 2023-11-08T19:53:54.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.78410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78410.log.gz 2023-11-08T19:53:54.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2023-11-08T19:53:54.666 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70915.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75655.log 2023-11-08T19:53:54.666 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70915.log.gz 2023-11-08T19:53:54.666 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72869.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72869.log.gz-5 2023-11-08T19:53:54.667 INFO:teuthology.orchestra.run.smithi196.stderr:--verbose -- /var/log/ceph/ceph-client.admin.44176.log 2023-11-08T19:53:54.667 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.35264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2023-11-08T19:53:54.667 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66031.log 2023-11-08T19:53:54.667 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.75655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75655.log.gz 2023-11-08T19:53:54.667 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37001.log 2023-11-08T19:53:54.668 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.44176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2023-11-08T19:53:54.668 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45945.log 2023-11-08T19:53:54.668 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66031.log.gz 2023-11-08T19:53:54.668 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36744.log 2023-11-08T19:53:54.669 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37001.log.gz 2023-11-08T19:53:54.669 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41597.log 2023-11-08T19:53:54.669 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.45945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45945.log.gz 2023-11-08T19:53:54.669 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70332.log 2023-11-08T19:53:54.670 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36744.log.gz 2023-11-08T19:53:54.670 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73509.log 2023-11-08T19:53:54.670 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41597.log.gz 2023-11-08T19:53:54.670 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2023-11-08T19:53:54.671 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70332.log.gz 2023-11-08T19:53:54.671 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60680.log 2023-11-08T19:53:54.671 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46092.log 2023-11-08T19:53:54.672 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40857.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.73509.log.gz 2023-11-08T19:53:54.672 INFO:teuthology.orchestra.run.smithi196.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz 2023-11-08T19:53:54.672 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.60680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64993.log 2023-11-08T19:53:54.672 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60680.log.gz 2023-11-08T19:53:54.673 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50766.log 2023-11-08T19:53:54.673 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.46092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz 2023-11-08T19:53:54.673 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.64993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76914.log 2023-11-08T19:53:54.673 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64993.log.gz 2023-11-08T19:53:54.674 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68658.log 2023-11-08T19:53:54.674 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.50766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50766.log.gz 2023-11-08T19:53:54.674 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-08T19:53:54.674 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.76914.log: 54.6% -- replaced with /var/log/ceph/ceph-client.admin.76914.log.gz 2023-11-08T19:53:54.675 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2023-11-08T19:53:54.675 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68658.log.gz 2023-11-08T19:53:54.675 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80927.log 2023-11-08T19:53:54.676 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.44193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37646.log 2023-11-08T19:53:54.676 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2023-11-08T19:53:54.676 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79927.log 2023-11-08T19:53:54.676 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80927.log.gz 2023-11-08T19:53:54.677 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37646.log.gz 2023-11-08T19:53:54.677 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42057.log 2023-11-08T19:53:54.677 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.79927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79927.log.gz 2023-11-08T19:53:54.677 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73615.log 2023-11-08T19:53:54.677 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80359.log 2023-11-08T19:53:54.678 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.42057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42057.log.gz 2023-11-08T19:53:54.678 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.73615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56218.log 2023-11-08T19:53:54.678 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73615.log.gz 2023-11-08T19:53:54.679 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.80359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41817.log 2023-11-08T19:53:54.679 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.80359.log.gz 2023-11-08T19:53:54.679 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2023-11-08T19:53:54.679 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.56218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51482.log 2023-11-08T19:53:54.679 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56218.log.gz 2023-11-08T19:53:54.680 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41817.log.gz 2023-11-08T19:53:54.680 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55099.log 2023-11-08T19:53:54.680 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2023-11-08T19:53:54.680 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.51482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51482.log.gz 2023-11-08T19:53:54.681 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74472.log 2023-11-08T19:53:54.681 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.55099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55099.log.gz 2023-11-08T19:53:54.681 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2023-11-08T19:53:54.681 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66224.log 2023-11-08T19:53:54.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.74472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74472.log.gz 2023-11-08T19:53:54.682 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.38035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2023-11-08T19:53:54.682 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41617.log 2023-11-08T19:53:54.683 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.66224.log: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.66224.log.gz 2023-11-08T19:53:54.683 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72977.log 2023-11-08T19:53:54.683 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33594.log 2023-11-08T19:53:54.683 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.41617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41617.log.gz 2023-11-08T19:53:54.684 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62008.log 2023-11-08T19:53:54.684 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.72977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72977.log.gz 2023-11-08T19:53:54.684 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70858.log 2023-11-08T19:53:54.685 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.33594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33594.log.gz 2023-11-08T19:53:54.685 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.62008.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68790.log 2023-11-08T19:53:54.685 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62008.log.gz 2023-11-08T19:53:54.685 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34089.log 2023-11-08T19:53:54.686 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.70858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70858.log.gz 2023-11-08T19:53:54.686 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68790.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39973.log 2023-11-08T19:53:54.686 INFO:teuthology.orchestra.run.smithi196.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68790.log.gz 2023-11-08T19:53:54.686 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68930.log 2023-11-08T19:53:54.687 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.34089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34089.log.gz 2023-11-08T19:53:54.687 INFO:teuthology.orchestra.run.smithi196.stderr:gzip /var/log/ceph/ceph-client.admin.39973.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71775.log 2023-11-08T19:53:54.687 INFO:teuthology.orchestra.run.smithi196.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39973.log.gz 2023-11-08T19:53:54.687 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.68930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68930.log.gz 2023-11-08T19:53:54.688 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40279.log 2023-11-08T19:53:54.688 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.71775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71775.log.gz 2023-11-08T19:53:54.688 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.40279.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40279.log.gz 2023-11-08T19:53:54.689 INFO:teuthology.orchestra.run.smithi196.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-08T19:53:56.187 INFO:teuthology.orchestra.run.smithi196.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-08T19:53:57.174 INFO:teuthology.orchestra.run.smithi196.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-08T19:54:20.160 INFO:teuthology.orchestra.run.smithi196.stderr: 96.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-08T19:54:30.583 INFO:teuthology.orchestra.run.smithi196.stderr: 97.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-08T19:54:30.584 INFO:teuthology.orchestra.run.smithi196.stderr: 2023-11-08T19:54:30.584 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m37.919s 2023-11-08T19:54:30.584 INFO:teuthology.orchestra.run.smithi196.stderr:user 1m11.440s 2023-11-08T19:54:30.585 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m3.357s 2023-11-08T19:54:30.586 INFO:tasks.ceph:Archiving logs... 2023-11-08T19:54:30.587 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000/remote/smithi196/log 2023-11-08T19:54:30.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-08T19:54:40.457 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-11-08T19:54:40.460 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-08T19:54:40.486 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-11-08T19:54:40.488 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-08T19:54:40.489 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-08T19:54:40.598 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-08T19:54:40.607 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-08T19:54:40.608 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-08T19:54:40.633 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2023-11-08T19:54:40.634 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2023-11-08T19:54:40.634 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 44.4.53.2 2 u 218 512 377 0.193 -1.307 0.398 2023-11-08T19:54:40.634 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 63.231.80.2 3 u 112 512 377 0.177 0.953 0.094 2023-11-08T19:54:40.635 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 117 512 377 0.168 1.967 0.142 2023-11-08T19:54:40.635 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-11-08T19:54:40.636 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-08T19:54:40.646 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-08T19:54:40.647 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-08T19:54:40.665 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-08T19:54:40.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-08T19:54:40.691 INFO:teuthology.task.internal:Duration was 12587.744589 seconds 2023-11-08T19:54:40.692 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-08T19:54:40.703 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-08T19:54:40.704 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-08T19:54:40.756 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-08T19:54:40.757 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2023-11-08T19:54:40.757 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-08T19:54:40.768 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-08T19:54:40.769 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-08T19:54:40.794 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-08T19:54:40.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-08T19:54:40.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-08T19:54:40.867 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-08T19:54:40.868 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-08T19:54:40.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-08T19:54:40.891 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:54:40.905 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2023-11-08T19:54:40.929 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-08T19:54:40.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:54:40.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-08T19:54:40.987 INFO:teuthology.task.internal:Transferring archived files... 2023-11-08T19:54:40.988 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000/remote/smithi196 2023-11-08T19:54:40.988 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-08T19:54:41.010 INFO:teuthology.task.internal:Removing archive directory... 2023-11-08T19:54:41.010 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-08T19:54:41.015 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-08T19:54:41.026 INFO:teuthology.task.internal:Not uploading archives. 2023-11-08T19:54:41.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-08T19:54:41.045 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-08T19:54:41.046 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-08T19:54:41.065 INFO:teuthology.orchestra.run.smithi196.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Nov 8 19:54 /home/ubuntu/cephtest 2023-11-08T19:54:41.066 INFO:teuthology.orchestra.run.smithi196.stdout: 1064625 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 8 16:33 /home/ubuntu/cephtest/mnt.0 2023-11-08T19:54:41.066 INFO:teuthology.orchestra.run.smithi196.stdout: 1064626 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 8 16:33 /home/ubuntu/cephtest/mnt.0/client.0 2023-11-08T19:54:41.066 INFO:teuthology.orchestra.run.smithi196.stdout: 1194457 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Nov 8 16:33 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-11-08T19:54:41.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-08T19:54:41.068 INFO:teuthology.orchestra.run.smithi196.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-11-08T19:54:41.069 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi196 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-11-08T19:54:41.081 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-08T19:54:41.094 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-08T19:54:41.175 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-11-08T19:54:41.176 INFO:teuthology.nuke:Checking targets against current locks 2023-11-08T19:54:41.212 DEBUG:teuthology.nuke:shortname: smithi196 2023-11-08T19:54:41.212 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-08T19:54:41.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-08_16:13:26-rbd-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452000', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 16:16:04.650162', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-08T19:54:41.288 INFO:teuthology.orchestra.console.smithi196:Power off 2023-11-08T19:54:41.290 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-08T19:54:41.318 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2023-11-08T19:54:41.319 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:54:41.343 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-11-08T19:54:45.346 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:54:45.456 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2023-11-08T19:54:49.458 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-08T19:54:49.568 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2023-11-08T19:54:49.669 INFO:teuthology.orchestra.console.smithi196:Power off completed 2023-11-08T19:54:49.776 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} duration: 12587.744589328766 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi196 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=cfb6fd52113be6a0af3fe7fb89b2e08474eadc0f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c190a677f3c2429187d949cc97620a62 status: fail success: false 2023-11-08T19:54:49.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-08T19:54:49.846 INFO:teuthology.run:FAIL